Aug 26 16:05:53 devstack cinder-volume[83350]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 16:05:53 devstack cinder-volume[83350]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 16:05:53 devstack cinder-volume[83350]: we strongly recommend against using it for new projects. Aug 26 16:05:53 devstack cinder-volume[83350]: If you are already using Eventlet, we recommend migrating to a different Aug 26 16:05:53 devstack cinder-volume[83350]: framework. For more detail see Aug 26 16:05:53 devstack cinder-volume[83350]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 16:05:53 devstack cinder-volume[83350]: import eventlet # noqa Aug 26 16:05:56 devstack cinder-volume[83350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 16:05:56 devstack cinder-volume[83350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 16:05:56 devstack cinder-volume[83350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 16:05:57 devstack cinder-volume[83350]: INFO dbcounter [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Registered counter for database cinder Aug 26 16:05:57 devstack cinder-volume[83350]: DEBUG oslo_db.sqlalchemy.engines [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 16:05:57 devstack cinder-volume[83350]: DEBUG dbcounter [-] [83350] Writer thread running {{(pid=83350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 16:05:57 devstack cinder-volume[83350]: INFO cinder.rpc [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 16:05:57 devstack cinder-volume[83350]: INFO cinder.rpc [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 16:05:57 devstack cinder-volume[83350]: DEBUG oslo_db.sqlalchemy.engines [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 16:05:57 devstack cinder-volume[83350]: INFO cinder.volume.manager [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Determined volume DB was empty at startup. Aug 26 16:05:57 devstack cinder-volume[83350]: DEBUG cinder.volume.manager [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83350) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 16:05:57 devstack cinder-volume[83350]: INFO cinder.volume.manager [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 26 16:05:57 devstack cinder-volume[83350]: WARNING stevedore.named [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 16:05:57 devstack cinder-volume[83350]: WARNING castellan.key_manager [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 16:05:57 devstack cinder-volume[83350]: WARNING cinder.keymgr.conf_key_mgr [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 16:05:57 devstack cinder-volume[83350]: DEBUG cinder.volume.drivers.lvm [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83350) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 26 16:05:57 devstack cinder-volume[83350]: DEBUG oslo_concurrency.processutils [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_concurrency.processutils [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] CMD "cinder-rtstool verify" returned: 0 in 0.406s {{(pid=83350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_db.sqlalchemy.engines [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 16:05:58 devstack cinder-volume[83350]: INFO cinder.rpc [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 26 16:05:58 devstack cinder-volume[83350]: INFO cinder.rpc [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 26 16:05:58 devstack cinder-volume[83350]: WARNING stevedore.named [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 16:05:58 devstack cinder-volume[83350]: WARNING castellan.key_manager [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 16:05:58 devstack cinder-volume[83350]: INFO cinder.volume.manager [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_db.sqlalchemy.engines [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 16:05:58 devstack cinder-volume[83350]: INFO oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Starting 1 workers Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Started child 83497 {{(pid=83350) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Full set of CONF: {{(pid=83350) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] ******************************************************************************** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Configuration options gathered from: {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] ================================================================================ {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 16:05:58 devstack cinder-volume[83497]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] allow_availability_zone_fallback = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] allow_compression_on_image_upload = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] allowed_direct_url_schemes = [] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] api_rate_limit = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] auth_strategy = keystone {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] az_cache_duration = 3600 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_availability_zone = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_host = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_name = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_stats_polling_interval = 60 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backup_api_class = cinder.backup.api.API {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backup_name_template = backup-%s {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backup_use_same_host = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backup_use_temp_snapshot = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] chap_password = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] chap_username = {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cinder_internal_tenant_project_id = bb44a463019e4620adca334be1122011 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cinder_internal_tenant_user_id = ceb0076ec2484d07b930a9f6cf4645af {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cloned_volume_same_az = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cluster = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] compression_format = gzip {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] compute_api_class = cinder.compute.nova.API {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] config_dir = [] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] config_source = [] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] control_exchange = openstack {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] debug = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] default_availability_zone = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] default_group_type = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] default_volume_type = lvmdriver-1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] disk_geometry = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] driver_client_cert = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] driver_client_cert_key = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] driver_data_namespace = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] driver_ssl_cert_path = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] driver_ssl_cert_verify = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] driver_use_ssl = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] enable_force_upload = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] enable_new_services = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] enable_unsupported_driver = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] enabled_backends = ['lvmdriver-1'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] enforce_multipath_for_image_xfer = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] filter_function = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance_api_insecure = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83497]: INFO cinder.volume.manager [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance_api_servers = ['http://192.168.122.244/image'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance_api_ssl_compression = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance_ca_certificates_file = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance_catalog_info = image:glance:publicURL {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance_certfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance_keyfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance_num_retries = 3 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance_request_timeout = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] goodness_function = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] graceful_shutdown_timeout = 5 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] group_api_class = cinder.group.api.API {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] host = devstack {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] image_compress_on_upload = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] image_conversion_address_space_limit = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] image_conversion_cpu_limit = 60 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] image_conversion_disable = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] image_upload_use_cinder_backend = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] image_upload_use_internal_tenant = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] image_volume_cache_enabled = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] image_volume_cache_max_count = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] image_volume_cache_max_size_gb = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] init_host_max_objects_retrieval = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] instance_format = [instance: %(uuid)s] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] iscsi_target_flags = {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] iscsi_write_cache = on {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] iser_helper = tgtadm {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] iser_ip_address = 192.168.122.244 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] iser_port = 3260 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] log_color = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] log_config_append = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] log_dir = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] log_file = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] log_options = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] log_rotate_interval = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] log_rotate_interval_type = days {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] log_rotation_type = none {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] max_age = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] max_logfile_count = 30 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] max_logfile_size_mb = 200 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] max_over_subscription_ratio = 20.0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] message_reap_interval = 86400 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] message_ttl = 2592000 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] migration_create_volume_timeout_secs = 300 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] monkey_patch = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] monkey_patch_modules = [] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] my_ip = 192.168.122.244 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] no_snapshot_gb_quota = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] num_iser_scan_tries = 3 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] num_shell_tries = 3 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] num_volume_device_scan_tries = 3 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] nvmeof_conn_info_version = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] nvmet_ns_id = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] nvmet_port_id = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] osapi_max_limit = 1000 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] osapi_volume_ext_list = [] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] osapi_volume_listen = 0.0.0.0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] osapi_volume_listen_port = 8776 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] osapi_volume_use_ssl = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] osapi_volume_workers = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] per_volume_size_limit = -1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] periodic_fuzzy_delay = 60 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] periodic_interval = 60 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] project_id_regex = [0-9a-f\-]+ {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] public_endpoint = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] publish_errors = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] quota_backup_gigabytes = 1000 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] quota_backups = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] quota_gigabytes = 1000 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] quota_groups = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] quota_snapshots = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] quota_volumes = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] rate_limit_burst = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] rate_limit_except_level = CRITICAL {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] rate_limit_interval = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] reinit_driver_count = 3 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] replication_device = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] report_discard_supported = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] report_interval = 120 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] reservation_clean_interval = 86400 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] reservation_expire = 86400 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] reserved_image_namespaces = [] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] reserved_percentage = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] rpc_response_timeout = 120 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] run_external_periodic_tasks = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] scst_target_driver = iscsi {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] scst_target_iqn_name = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] service_down_time = 720 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] shell_completion = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] snapshot_name_template = snapshot-%s {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] snapshot_same_host = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] split_loggers = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] state_path = /opt/stack/data/cinder {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] storage_availability_zone = nova {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] storage_protocol = iSCSI {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] syslog_log_facility = LOG_USER {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] target_helper = lioadm {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] target_ip_address = 192.168.122.244 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] target_port = 3260 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] target_protocol = iscsi {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] target_secondary_ip_addresses = [] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] trace_flags = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] transfer_api_class = cinder.transfer.api.API {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] transport_url = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] until_refresh = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] use_chap_auth = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] use_default_quota_class = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] use_journal = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] use_json = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] use_multipath_for_image_xfer = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] use_stderr = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] use_syslog = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] verify_glance_signatures = enabled {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] volume_api_class = cinder.volume.api.API {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] volume_backend_name = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] volume_clear = zero {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] volume_clear_ionice = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] volume_clear_size = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] volume_copy_bps_limit = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] volume_dd_blocksize = 1M {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] volume_name_template = volume-%s {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] volume_service_inithost_offload = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] volume_usage_audit_period = month {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:05:58 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] zoning_mode = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_concurrency.disable_process_locking = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.auth_section = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.auth_type = password {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.auth_version = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.cache = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.certfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.delay_auth_decision = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.http_connect_timeout = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.include_service_catalog = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.insecure = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.interface = public {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.keyfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_password = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcache_username = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.region_name = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.service_token_roles_required = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.service_type = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.token_cache_time = 300 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.244/identity {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.backend = dogpile.cache.null {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.backend_argument = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.backend_expiration_time = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.config_prefix = cache.oslo {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.debug_cache_backend = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.enable_retry_client = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.enable_socket_keepalive = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.enabled = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.expiration_time = 600 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.hashclient_retry_attempts = 2 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.memcache_dead_retry = 300 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.memcache_pool_maxsize = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.memcache_sasl_enabled = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:05:58 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.password = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.proxies = [] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.redis_db = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.redis_sentinel_service_name = mymaster {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.redis_server = localhost:6379 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.retry_attempts = 2 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.retry_delay = 0.0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.socket_keepalive_count = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.socket_keepalive_idle = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.socket_keepalive_interval = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.socket_timeout = 1.0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.tls_allowed_ciphers = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.tls_cafile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.tls_certfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.tls_enabled = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.tls_keyfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cache.username = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] coordination.backend_url = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.asyncio_connection = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.asyncio_slave_connection = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.backend = sqlalchemy {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.connection = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.connection_debug = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.connection_parameters = {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.connection_recycle_time = 3600 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.connection_trace = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.db_inc_retry_interval = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.db_max_retries = 20 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.db_max_retry_interval = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.db_retry_interval = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack sudo[83501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 26 16:05:58 devstack sudo[83501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.max_overflow = 50 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.max_pool_size = 5 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.max_retries = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.mysql_wsrep_sync_wait = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.pool_timeout = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.retry_interval = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.slave_connection = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.sqlite_synchronous = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.synchronous_reader = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] database.use_db_reconnect = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler.connection_string = messaging:// {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler.enabled = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler.es_doc_type = notification {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler.es_scroll_size = 10000 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler.es_scroll_time = 2m {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler.filter_error_trace = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler.hmac_keys = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler.sentinel_service_name = mymaster {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler.socket_timeout = 0.1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler.trace_requests = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler.trace_sqlalchemy = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler_jaeger.process_tags = {} {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler_jaeger.service_name_prefix = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] profiler_otlp.service_name_prefix = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_policy.enforce_new_defaults = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_policy.policy_default_rule = default {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_policy.policy_file = policy.yaml {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_policy.remote_timeout = 60.0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] privsep_osbrick.group = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] privsep_osbrick.helper_command = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] privsep_osbrick.user = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cinder_sys_admin.group = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cinder_sys_admin.helper_command = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] cinder_sys_admin.user = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] service_user.auth_section = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] service_user.auth_type = password {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] service_user.cafile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] service_user.certfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] service_user.collect_timing = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] service_user.insecure = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] service_user.keyfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] service_user.send_service_user_token = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] service_user.split_loggers = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] service_user.timeout = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance.auth_section = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance.auth_type = password {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance.certfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance.collect_timing = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance.insecure = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance.keyfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance.region_name = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance.split_loggers = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] glance.timeout = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.backend_availability_zone = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.chap_password = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.chap_username = {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.disk_geometry = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.driver_client_cert = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.driver_client_cert_key = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.driver_data_namespace = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.driver_use_ssl = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.enable_unsupported_driver = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.extra_capabilities = {} {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.filter_function = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.goodness_function = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.iscsi_target_flags = {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.iscsi_write_cache = on {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.iser_helper = tgtadm {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.iser_ip_address = 192.168.122.244 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.iser_port = 3260 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.lvm_mirrors = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.lvm_share_target = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.lvm_type = auto {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.num_shell_tries = 3 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.nvmet_port_id = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.replication_device = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.report_discard_supported = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.reserved_percentage = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.scst_target_driver = iscsi {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.scst_target_iqn_name = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.storage_protocol = iSCSI {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.target_helper = tgtadm {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.target_ip_address = 192.168.122.244 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.target_port = 3260 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.target_protocol = iscsi {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.trace_flags = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.unique_fqdn_network = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.use_chap_auth = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.volume_backend_name = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.volume_clear = zero {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.volume_clear_ionice = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.volume_clear_size = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.volume_group = cinder-volumes {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_reports.file_event_handler = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_reports.log_dir = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.backend_availability_zone = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.backend_host = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.chap_password = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.chap_username = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.chiscsi_conf = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.disk_geometry = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.driver_client_cert = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.driver_data_namespace = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.driver_use_ssl = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.extra_capabilities = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.filter_function = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.goodness_function = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.iser_helper = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.iser_ip_address = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.iser_port = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.iser_target_prefix = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.lvm_conf_file = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.lvm_mirrors = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.lvm_share_target = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.lvm_type = auto {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.num_shell_tries = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.nvmet_port_id = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.replication_device = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.report_discard_supported = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.reserved_percentage = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.scst_target_driver = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.storage_protocol = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.target_helper = lioadm {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.target_ip_address = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.target_port = 3260 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.target_protocol = iscsi {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.trace_flags = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.use_chap_auth = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.volume_clear = zero {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.volume_clear_size = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] lvmdriver-1.volumes_dir = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.ssl = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.ssl_version = {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_notifications.driver = [] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_notifications.retry = -1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] oslo_messaging_notifications.transport_url = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] key_manager.fixed_key = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.barbican_api_version = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.barbican_endpoint = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.barbican_endpoint_type = public {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.barbican_region_name = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.cafile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.certfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.collect_timing = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.insecure = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.keyfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.number_of_retries = 60 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.retry_delay = 1 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.send_service_user_token = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.split_loggers = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.timeout = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.verify_ssl = True {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican.verify_ssl_path = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican_service_user.auth_section = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican_service_user.auth_type = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican_service_user.cafile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican_service_user.certfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican_service_user.collect_timing = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican_service_user.insecure = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican_service_user.keyfile = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican_service_user.split_loggers = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] barbican_service_user.timeout = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.approle_role_id = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.approle_secret_id = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.auth_method = approle {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.auth_path = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.kv_mountpoint = secret {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.kv_path = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.kv_version = 2 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.namespace = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.root_token_id = **** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.ssl_ca_crt_file = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.timeout = 60.0 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.token_file = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.token_role = None {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.use_ssl = False {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:05:58 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] ******************************************************************************** {{(pid=83350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 16:05:58 devstack sudo[83501]: pam_unix(sudo:session): session closed for user root Aug 26 16:05:58 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:05:58 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:05:58 devstack sudo[83567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 16:05:58 devstack sudo[83567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:05:59 devstack sudo[83567]: pam_unix(sudo:session): session closed for user root Aug 26 16:05:59 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.260s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:05:59 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:05:59 devstack cinder-volume[83497]: INFO cinder.brick.local_dev.lvm [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 26 16:05:59 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:05:59 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:05:59 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:05:59 devstack sudo[83686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 16:05:59 devstack sudo[83686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:05:59 devstack sudo[83686]: pam_unix(sudo:session): session closed for user root Aug 26 16:05:59 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:05:59 devstack cinder-volume[83497]: DEBUG cinder.brick.local_dev.lvm [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83497) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 26 16:05:59 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:05:59 devstack sudo[83757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 16:05:59 devstack sudo[83757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:05:59 devstack sudo[83757]: pam_unix(sudo:session): session closed for user root Aug 26 16:05:59 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.524s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:05:59 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:05:59 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:05:59 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:05:59 devstack sudo[83957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 16:05:59 devstack sudo[83957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:00 devstack sudo[83957]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:00 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:00 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:00 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:00 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:00 devstack sudo[84049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 26 16:06:00 devstack sudo[84049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:00 devstack sudo[84049]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:00 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.317s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:00 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:00 devstack sudo[84108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 16:06:00 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:00 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:00 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:00 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:00 devstack sudo[84117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 16:06:00 devstack sudo[84117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:01 devstack sudo[84117]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:01 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.343s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:01 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:01 devstack sudo[84195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 16:06:01 devstack sudo[84195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:01 devstack sudo[84195]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:01 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:01 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:01 devstack sudo[84205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 16:06:01 devstack sudo[84205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:01 devstack sudo[84205]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:01 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:01 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:01 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:01 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:01 devstack sudo[84294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 16:06:01 devstack sudo[84294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:02 devstack sudo[84294]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:02 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:02 devstack cinder-volume[83497]: INFO cinder.volume.drivers.lvm [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 26 16:06:02 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:02 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:02 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:02 devstack sudo[84298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 16:06:02 devstack sudo[84298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:02 devstack sudo[84298]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:02 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:02 devstack cinder-volume[83497]: DEBUG cinder.volume.drivers.lvm [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Updating volume stats {{(pid=83497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 16:06:02 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:02 devstack sudo[84301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 16:06:02 devstack sudo[84301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:02 devstack sudo[84301]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:02 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:02 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:02 devstack sudo[84304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 16:06:02 devstack sudo[84304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:02 devstack sudo[84304]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:02 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:02 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:02 devstack sudo[84307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 16:06:02 devstack sudo[84307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:03 devstack sudo[84307]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:03 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:03 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:03 devstack sudo[84311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 16:06:03 devstack sudo[84311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:03 devstack sudo[84311]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:03 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:03 devstack cinder-volume[83497]: INFO cinder.volume.driver [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 16:06:03 devstack cinder-volume[83497]: DEBUG cinder.volume.driver [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83497) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 16:06:03 devstack cinder-volume[83497]: DEBUG oslo_db.sqlalchemy.engines [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83497) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 16:06:03 devstack cinder-volume[83497]: DEBUG dbcounter [-] [83497] Writer thread running {{(pid=83497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 16:06:03 devstack cinder-volume[83497]: DEBUG cinder.db.api [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Building query based on filter {{(pid=83497) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 16:06:03 devstack cinder-volume[83497]: DEBUG cinder.image.image_utils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83497) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 16:06:03 devstack cinder-volume[83497]: INFO cinder.keymgr.migration [None req-a7f0329e-e175-495a-8813-27c00a103d5e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 16:06:03 devstack cinder-volume[83497]: DEBUG cinder.volume.drivers.lvm [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Updating volume stats {{(pid=83497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 16:06:03 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:03 devstack sudo[84315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 16:06:03 devstack sudo[84315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:03 devstack sudo[84315]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:03 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:03 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:03 devstack sudo[84320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 16:06:03 devstack sudo[84320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:04 devstack sudo[84320]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:04 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:04 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:04 devstack sudo[84323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 16:06:04 devstack sudo[84323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:04 devstack sudo[84323]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:04 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:04 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:04 devstack sudo[84326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 16:06:04 devstack sudo[84326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:04 devstack sudo[84326]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:04 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:04 devstack cinder-volume[83497]: DEBUG cinder.manager [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Notifying Schedulers of capabilities ... {{(pid=83497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:06:04 devstack cinder-volume[83497]: INFO cinder.volume.manager [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Driver initialization completed successfully. Aug 26 16:06:04 devstack cinder-volume[83497]: INFO cinder.manager [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Initiating service 2 cleanup Aug 26 16:06:04 devstack cinder-volume[83497]: INFO cinder.manager [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Service 2 cleanup completed. Aug 26 16:06:04 devstack cinder-volume[83497]: DEBUG cinder.service [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Creating RPC server for service cinder-volume {{(pid=83497) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 16:06:04 devstack cinder-volume[83497]: DEBUG cinder.service [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83497) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 16:06:04 devstack cinder-volume[83497]: INFO cinder.volume.manager [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 26 16:06:04 devstack cinder-volume[83497]: DEBUG cinder.volume.drivers.lvm [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Updating volume stats {{(pid=83497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 16:06:04 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:04 devstack sudo[84332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 16:06:04 devstack sudo[84332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:05 devstack sudo[84332]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:05 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:05 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:05 devstack sudo[84337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 16:06:05 devstack sudo[84337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:05 devstack sudo[84337]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:05 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:05 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:05 devstack sudo[84340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 16:06:05 devstack sudo[84340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:05 devstack sudo[84340]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:05 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:05 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:06:05 devstack sudo[84343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 16:06:05 devstack sudo[84343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:06:05 devstack sudo[84343]: pam_unix(sudo:session): session closed for user root Aug 26 16:06:05 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:06:05 devstack cinder-volume[83497]: INFO cinder.volume.manager [None req-db9b070f-918b-4643-83a9-fbc230537703 None None] Driver post RPC initialization completed successfully. Aug 26 16:06:08 devstack cinder-volume[83350]: DEBUG dbcounter [-] [83350] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:06:15 devstack cinder-volume[83497]: DEBUG dbcounter [-] [83497] Writing DB stats cinder:SELECT=4 {{(pid=83497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:06:15 devstack cinder-volume[83497]: DEBUG dbcounter [-] [83497] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:06:29 devstack cinder-volume[83497]: DEBUG oslo_service.periodic_task [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running periodic task VolumeManager._thread_info {{(pid=83497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:06:29 devstack cinder-volume[83497]: DEBUG cinder.volume.manager [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] thread count: 6 {{(pid=83497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:06:29 devstack cinder-volume[83497]: DEBUG cinder.volume.manager [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] thread info: [<_MainThread(MainThread, started 135590255157376)>, , , , , ] {{(pid=83497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:07:29 devstack cinder-volume[83497]: DEBUG oslo_service.periodic_task [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:07:29 devstack cinder-volume[83497]: DEBUG cinder.volume.drivers.lvm [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Updating volume stats {{(pid=83497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 16:07:29 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:07:29 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 16:07:29 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:07:30 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Aug 26 16:07:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:07:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:07:30 devstack sudo[87018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 16:07:30 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:07:30 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root Aug 26 16:07:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:07:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:07:30 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 16:07:30 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:07:30 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Aug 26 16:07:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:07:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:07:30 devstack sudo[87024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 16:07:30 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:07:30 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root Aug 26 16:07:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:07:30 devstack cinder-volume[83497]: DEBUG cinder.manager [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Notifying Schedulers of capabilities ... {{(pid=83497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:07:30 devstack cinder-volume[83497]: DEBUG oslo_service.periodic_task [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running periodic task VolumeManager._thread_info {{(pid=83497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:07:30 devstack cinder-volume[83497]: DEBUG cinder.volume.manager [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] thread count: 6 {{(pid=83497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:07:30 devstack cinder-volume[83497]: DEBUG cinder.volume.manager [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] thread info: [<_MainThread(MainThread, started 135590255157376)>, , , , , ] {{(pid=83497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:08:15 devstack cinder-volume[83497]: DEBUG dbcounter [-] [83497] Writing DB stats cinder:SELECT=1 {{(pid=83497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:08:15 devstack cinder-volume[83497]: DEBUG dbcounter [-] [83497] Writing DB stats cinder:UPDATE=1 {{(pid=83497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:08:29 devstack cinder-volume[83497]: DEBUG oslo_service.periodic_task [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:08:29 devstack cinder-volume[83497]: DEBUG cinder.volume.drivers.lvm [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Updating volume stats {{(pid=83497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 16:08:29 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:08:29 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 16:08:29 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:08:30 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Aug 26 16:08:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:08:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:08:30 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 16:08:30 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:08:30 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Aug 26 16:08:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:08:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:08:30 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 16:08:30 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:08:30 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Aug 26 16:08:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:08:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:08:30 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 16:08:30 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:08:30 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Aug 26 16:08:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:08:30 devstack cinder-volume[83497]: DEBUG cinder.manager [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Notifying Schedulers of capabilities ... {{(pid=83497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:09:29 devstack cinder-volume[83497]: DEBUG oslo_service.periodic_task [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:09:29 devstack cinder-volume[83497]: DEBUG cinder.volume.drivers.lvm [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Updating volume stats {{(pid=83497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 16:09:29 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:09:29 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 16:09:29 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:09:30 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Aug 26 16:09:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:09:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:09:30 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 16:09:30 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:09:30 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Aug 26 16:09:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:09:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:09:30 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 16:09:30 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:09:30 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Aug 26 16:09:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:09:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:09:30 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 16:09:30 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:09:30 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Aug 26 16:09:30 devstack cinder-volume[83497]: DEBUG oslo_concurrency.processutils [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=83497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:09:30 devstack cinder-volume[83497]: DEBUG cinder.manager [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Notifying Schedulers of capabilities ... {{(pid=83497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:09:30 devstack cinder-volume[83497]: DEBUG oslo_service.periodic_task [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] Running periodic task VolumeManager._thread_info {{(pid=83497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:09:30 devstack cinder-volume[83497]: DEBUG cinder.volume.manager [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] thread count: 6 {{(pid=83497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:09:30 devstack cinder-volume[83497]: DEBUG cinder.volume.manager [None req-f98c091e-7408-445c-b99c-679cd212f801 None None] thread info: [<_MainThread(MainThread, started 135590255157376)>, , , , , ] {{(pid=83497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:10:15 devstack cinder-volume[83497]: DEBUG dbcounter [-] [83497] Writing DB stats cinder:SELECT=1 {{(pid=83497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:10:15 devstack cinder-volume[83497]: DEBUG dbcounter [-] [83497] Writing DB stats cinder:UPDATE=1 {{(pid=83497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:10:25 devstack cinder-volume[83350]: INFO oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Caught SIGTERM, stopping children Aug 26 16:10:25 devstack cinder-volume[83350]: DEBUG oslo_concurrency.lockutils [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Acquiring lock "singleton_lock" {{(pid=83350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 16:10:25 devstack cinder-volume[83350]: DEBUG oslo_concurrency.lockutils [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Acquired lock "singleton_lock" {{(pid=83350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 16:10:25 devstack cinder-volume[83350]: DEBUG oslo_concurrency.lockutils [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Releasing lock "singleton_lock" {{(pid=83350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 16:10:25 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Stop services. {{(pid=83350) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 16:10:25 devstack cinder-volume[83350]: DEBUG oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Killing children. {{(pid=83350) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 16:10:25 devstack cinder-volume[83350]: INFO oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Waiting on 1 children to exit Aug 26 16:10:29 devstack cinder-volume[83497]: DEBUG oslo_concurrency.lockutils [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Acquiring lock "singleton_lock" {{(pid=83497) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 16:10:29 devstack cinder-volume[83497]: DEBUG oslo_concurrency.lockutils [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Acquired lock "singleton_lock" {{(pid=83497) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 16:10:29 devstack cinder-volume[83497]: DEBUG oslo_concurrency.lockutils [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Releasing lock "singleton_lock" {{(pid=83497) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 16:10:29 devstack cinder-volume[83497]: WARNING amqp [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 16:10:29 devstack cinder-volume[83497]: WARNING amqp [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 16:10:29 devstack cinder-volume[83350]: INFO oslo_service.backend._eventlet.service [None req-58e7d6ed-6205-4bd3-be9f-81e5fa430c5c None None] Child 83497 exited with status 0 Aug 26 16:10:30 devstack cinder-volume[93600]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 16:10:30 devstack cinder-volume[93600]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 16:10:30 devstack cinder-volume[93600]: we strongly recommend against using it for new projects. Aug 26 16:10:30 devstack cinder-volume[93600]: If you are already using Eventlet, we recommend migrating to a different Aug 26 16:10:30 devstack cinder-volume[93600]: framework. For more detail see Aug 26 16:10:30 devstack cinder-volume[93600]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 16:10:30 devstack cinder-volume[93600]: import eventlet # noqa Aug 26 16:10:32 devstack cinder-volume[93600]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 16:10:32 devstack cinder-volume[93600]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 16:10:32 devstack cinder-volume[93600]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 16:10:32 devstack cinder-volume[93600]: INFO dbcounter [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Registered counter for database cinder Aug 26 16:10:32 devstack cinder-volume[93600]: DEBUG oslo_db.sqlalchemy.engines [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG dbcounter [-] [93600] Writer thread running {{(pid=93600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 16:10:33 devstack cinder-volume[93600]: INFO cinder.rpc [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 16:10:33 devstack cinder-volume[93600]: INFO cinder.rpc [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_db.sqlalchemy.engines [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 16:10:33 devstack cinder-volume[93600]: INFO cinder.volume.manager [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Determined volume DB was empty at startup. Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG cinder.volume.manager [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93600) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 16:10:33 devstack cinder-volume[93600]: INFO cinder.volume.manager [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 26 16:10:33 devstack cinder-volume[93600]: WARNING stevedore.named [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 16:10:33 devstack cinder-volume[93600]: WARNING castellan.key_manager [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 16:10:33 devstack cinder-volume[93600]: WARNING cinder.keymgr.conf_key_mgr [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 16:10:33 devstack cinder-volume[93600]: INFO cinder.volume.manager [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_db.sqlalchemy.engines [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 16:10:33 devstack cinder-volume[93600]: INFO oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Starting 1 workers Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Started child 93821 {{(pid=93600) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Full set of CONF: {{(pid=93600) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] ******************************************************************************** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Configuration options gathered from: {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] ================================================================================ {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] allow_availability_zone_fallback = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] allow_compression_on_image_upload = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] allowed_direct_url_schemes = [] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] api_rate_limit = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] auth_strategy = keystone {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_availability_zone = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_host = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_name = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_stats_polling_interval = 60 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backup_api_class = cinder.backup.api.API {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backup_name_template = backup-%s {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backup_use_same_host = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93821]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backup_use_temp_snapshot = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] chap_password = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] chap_username = {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cinder_internal_tenant_project_id = bb44a463019e4620adca334be1122011 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cinder_internal_tenant_user_id = ceb0076ec2484d07b930a9f6cf4645af {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cluster = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] compression_format = gzip {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] compute_api_class = cinder.compute.nova.API {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] config_dir = [] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] config_source = [] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] control_exchange = openstack {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] debug = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] default_availability_zone = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] default_group_type = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] default_volume_type = QuobyteHD {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] disk_geometry = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] driver_client_cert = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] driver_client_cert_key = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] driver_data_namespace = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] driver_ssl_cert_path = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] driver_ssl_cert_verify = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] driver_use_ssl = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] enable_new_services = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] enable_unsupported_driver = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] enabled_backends = ['QuobyteHD'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] enforce_multipath_for_image_xfer = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] filter_function = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance_api_insecure = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance_api_servers = ['http://192.168.122.244/image'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance_api_ssl_compression = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance_ca_certificates_file = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance_catalog_info = image:glance:publicURL {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance_certfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance_keyfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance_num_retries = 3 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance_request_timeout = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] goodness_function = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] graceful_shutdown_timeout = 5 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] group_api_class = cinder.group.api.API {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] host = devstack {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] image_compress_on_upload = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] image_conversion_address_space_limit = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] image_conversion_cpu_limit = 60 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] image_conversion_disable = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] image_upload_use_cinder_backend = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] image_upload_use_internal_tenant = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] image_volume_cache_enabled = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] image_volume_cache_max_count = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] image_volume_cache_max_size_gb = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] init_host_max_objects_retrieval = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] instance_format = [instance: %(uuid)s] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] iscsi_target_flags = {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] iscsi_write_cache = on {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] iser_helper = tgtadm {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] iser_ip_address = 192.168.122.244 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] iser_port = 3260 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] log_color = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] log_config_append = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] log_dir = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] log_file = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] log_options = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] log_rotate_interval = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] log_rotate_interval_type = days {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] log_rotation_type = none {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] max_age = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] max_logfile_count = 30 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] max_logfile_size_mb = 200 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] max_over_subscription_ratio = 20.0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] message_reap_interval = 86400 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] message_ttl = 2592000 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] migration_create_volume_timeout_secs = 300 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] monkey_patch = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] monkey_patch_modules = [] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] my_ip = 192.168.122.244 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] no_snapshot_gb_quota = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] num_iser_scan_tries = 3 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] num_shell_tries = 3 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] num_volume_device_scan_tries = 3 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] nvmeof_conn_info_version = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] nvmet_ns_id = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] nvmet_port_id = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] osapi_max_limit = 1000 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] osapi_volume_ext_list = [] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] osapi_volume_listen = 0.0.0.0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] osapi_volume_listen_port = 8776 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] osapi_volume_use_ssl = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] osapi_volume_workers = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] per_volume_size_limit = -1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] periodic_fuzzy_delay = 60 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] periodic_interval = 60 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] project_id_regex = [0-9a-f\-]+ {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] public_endpoint = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] publish_errors = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] quota_backup_gigabytes = 1000 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] quota_backups = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] quota_gigabytes = 1000 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] quota_groups = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] quota_snapshots = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] quota_volumes = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] rate_limit_burst = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] rate_limit_except_level = CRITICAL {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] rate_limit_interval = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] reinit_driver_count = 3 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] replication_device = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] report_discard_supported = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] report_interval = 120 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] reservation_clean_interval = 86400 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] reservation_expire = 86400 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] reserved_image_namespaces = [] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] reserved_percentage = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] rpc_response_timeout = 120 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] run_external_periodic_tasks = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] scst_target_driver = iscsi {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] scst_target_iqn_name = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] service_down_time = 720 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] shell_completion = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] snapshot_name_template = snapshot-%s {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] split_loggers = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] state_path = /opt/stack/data/cinder {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] storage_availability_zone = nova {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] storage_protocol = iSCSI {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] syslog_log_facility = LOG_USER {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] target_helper = lioadm {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] target_ip_address = 192.168.122.244 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] target_port = 3260 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] target_protocol = iscsi {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] target_secondary_ip_addresses = [] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] trace_flags = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] transfer_api_class = cinder.transfer.api.API {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] transport_url = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] until_refresh = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] use_chap_auth = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] use_default_quota_class = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] use_journal = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] use_json = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] use_multipath_for_image_xfer = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] use_stderr = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] use_syslog = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93821]: INFO cinder.volume.manager [None req-42287c28-0b86-4540-9699-991404bd177a None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] verify_glance_signatures = enabled {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] volume_api_class = cinder.volume.api.API {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] volume_backend_name = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] volume_clear = zero {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] volume_clear_ionice = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] volume_clear_size = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] volume_copy_bps_limit = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] volume_dd_blocksize = 1M {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93821]: DEBUG cinder.volume.drivers.remotefs [None req-42287c28-0b86-4540-9699-991404bd177a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93821) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] volume_name_template = volume-%s {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] volume_service_inithost_offload = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] volume_usage_audit_period = month {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] zoning_mode = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_concurrency.disable_process_locking = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.auth_section = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.auth_type = password {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.auth_version = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.cache = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.certfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.delay_auth_decision = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.http_connect_timeout = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.include_service_catalog = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.insecure = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.interface = public {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.keyfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_password = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcache_username = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.region_name = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.service_token_roles_required = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.service_type = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.token_cache_time = 300 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.244/identity {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.backend = dogpile.cache.null {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.backend_argument = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.backend_expiration_time = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.config_prefix = cache.oslo {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.debug_cache_backend = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.enable_retry_client = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.enable_socket_keepalive = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.enabled = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.expiration_time = 600 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.hashclient_retry_attempts = 2 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.memcache_dead_retry = 300 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.memcache_pool_maxsize = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.memcache_sasl_enabled = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.password = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.proxies = [] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.redis_db = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.redis_sentinel_service_name = mymaster {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.redis_server = localhost:6379 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.retry_attempts = 2 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.retry_delay = 0.0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.socket_keepalive_count = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.socket_keepalive_idle = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.socket_keepalive_interval = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.socket_timeout = 1.0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.tls_allowed_ciphers = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.tls_cafile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.tls_certfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.tls_enabled = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.tls_keyfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cache.username = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] coordination.backend_url = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.asyncio_connection = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.asyncio_slave_connection = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.backend = sqlalchemy {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.connection = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.connection_debug = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.connection_parameters = {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.connection_recycle_time = 3600 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.connection_trace = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.db_inc_retry_interval = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.db_max_retries = 20 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.db_max_retry_interval = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.db_retry_interval = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.max_overflow = 50 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.max_pool_size = 5 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.max_retries = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.mysql_wsrep_sync_wait = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.pool_timeout = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.retry_interval = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.slave_connection = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.sqlite_synchronous = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.synchronous_reader = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] database.use_db_reconnect = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler.connection_string = messaging:// {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler.enabled = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler.es_doc_type = notification {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler.es_scroll_size = 10000 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler.es_scroll_time = 2m {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler.filter_error_trace = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler.hmac_keys = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler.sentinel_service_name = mymaster {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler.socket_timeout = 0.1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler.trace_requests = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler.trace_sqlalchemy = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler_jaeger.process_tags = {} {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler_jaeger.service_name_prefix = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] profiler_otlp.service_name_prefix = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_policy.enforce_new_defaults = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_policy.policy_default_rule = default {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_policy.policy_file = policy.yaml {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_policy.remote_timeout = 60.0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] privsep_osbrick.group = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] privsep_osbrick.helper_command = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] privsep_osbrick.user = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cinder_sys_admin.group = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cinder_sys_admin.helper_command = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] cinder_sys_admin.user = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] service_user.auth_section = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] service_user.auth_type = password {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] service_user.cafile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] service_user.certfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] service_user.collect_timing = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] service_user.insecure = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] service_user.keyfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] service_user.send_service_user_token = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] service_user.split_loggers = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] service_user.timeout = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance.auth_section = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance.auth_type = password {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance.certfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance.collect_timing = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance.insecure = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance.keyfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance.region_name = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance.split_loggers = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] glance.timeout = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.backend_availability_zone = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.chap_password = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.chap_username = {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.disk_geometry = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.driver_client_cert = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.driver_client_cert_key = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.driver_data_namespace = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93821]: DEBUG cinder.volume.drivers.quobyte [None req-42287c28-0b86-4540-9699-991404bd177a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93821) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.driver_use_ssl = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.enable_unsupported_driver = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93821]: WARNING cinder.volume.drivers.quobyte [None req-42287c28-0b86-4540-9699-991404bd177a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 16:10:33 devstack cinder-volume[93821]: WARNING cinder.volume.drivers.quobyte [None req-42287c28-0b86-4540-9699-991404bd177a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.extra_capabilities = {} {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.filter_function = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.goodness_function = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93821]: DEBUG oslo_concurrency.processutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Running cmd (subprocess): mount.quobyte {{(pid=93821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.iscsi_target_flags = {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.iscsi_write_cache = on {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.iser_helper = tgtadm {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.iser_ip_address = 192.168.122.244 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.iser_port = 3260 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.nas_host = {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.nas_login = admin {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.nas_mount_options = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.nas_password = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.nas_private_key = {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.nas_share_path = {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.nas_ssh_port = 22 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.num_shell_tries = 3 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.nvmet_port_id = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.quobyte_client_cfg = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.quobyte_volume_url = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.replication_device = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.report_discard_supported = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.reserved_percentage = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.scst_target_driver = iscsi {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.scst_target_iqn_name = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.storage_protocol = iSCSI {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.target_helper = tgtadm {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.target_ip_address = 192.168.122.244 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.target_port = 3260 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.target_protocol = iscsi {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.trace_flags = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.unique_fqdn_network = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.use_chap_auth = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.volume_backend_name = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.volume_clear = zero {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.volume_clear_ionice = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.volume_clear_size = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_reports.file_event_handler = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_reports.log_dir = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.backend_availability_zone = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.backend_host = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.chap_password = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.chap_username = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.chiscsi_conf = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.disk_geometry = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.driver_client_cert = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.driver_client_cert_key = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.driver_data_namespace = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.driver_use_ssl = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.enable_unsupported_driver = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.extra_capabilities = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.filter_function = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.goodness_function = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.iscsi_target_flags = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.iscsi_write_cache = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.iser_helper = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.iser_ip_address = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.iser_port = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.iser_target_prefix = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.nas_host = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.nas_login = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.nas_mount_options = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.nas_password = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.nas_private_key = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack quobyte-client[93826]: Reading configuration file: /etc/quobyte/client.cfg Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.nas_share_path = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.nas_ssh_port = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.num_shell_tries = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack quobyte-client[93826]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93821]: DEBUG oslo_concurrency.processutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=93821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.nvmet_ns_id = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93821]: DEBUG oslo_concurrency.lockutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.nvmet_port_id = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93821]: DEBUG oslo_concurrency.lockutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:10:33 devstack cinder-volume[93821]: DEBUG cinder.volume.drivers.quobyte [None req-42287c28-0b86-4540-9699-991404bd177a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=93821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93821]: INFO cinder.volume.drivers.quobyte [None req-42287c28-0b86-4540-9699-991404bd177a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 ... Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93821]: DEBUG oslo_concurrency.processutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 -c /etc/quobyte/client-cinder.cfg {{(pid=93821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.replication_device = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.report_discard_supported = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.reserved_percentage = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.scst_target_driver = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.storage_protocol = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.target_helper = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.target_ip_address = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.target_port = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.target_prefix = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.target_protocol = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:33 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.trace_flags = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.unique_fqdn_network = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.use_chap_auth = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.volume_clear = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.volume_clear_ionice = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.volume_clear_size = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] QuobyteHD.volumes_dir = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 -c /etc/quobyte/client-cinder.cfg Aug 26 16:10:34 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.ssl = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.ssl_version = {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_notifications.driver = [] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_notifications.retry = -1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] oslo_messaging_notifications.transport_url = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] key_manager.fixed_key = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.barbican_api_version = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.barbican_endpoint = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.barbican_endpoint_type = public {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.barbican_region_name = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.cafile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.certfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.collect_timing = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.insecure = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.keyfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.number_of_retries = 60 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.retry_delay = 1 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.send_service_user_token = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.split_loggers = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.timeout = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.verify_ssl = True {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican.verify_ssl_path = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican_service_user.auth_section = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican_service_user.auth_type = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican_service_user.cafile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican_service_user.certfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican_service_user.collect_timing = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican_service_user.insecure = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican_service_user.keyfile = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican_service_user.split_loggers = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] barbican_service_user.timeout = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.approle_role_id = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.approle_secret_id = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.auth_method = approle {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.auth_path = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.kv_mountpoint = secret {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.kv_path = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.kv_version = 2 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.namespace = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.root_token_id = **** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.ssl_ca_crt_file = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.timeout = 60.0 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.token_file = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.token_role = None {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.use_ssl = False {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:34 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] ******************************************************************************** {{(pid=93600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 16:10:34 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG oslo_concurrency.processutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.363s {{(pid=93821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:10:34 devstack cinder-volume[93821]: INFO cinder.volume.drivers.quobyte [None req-42287c28-0b86-4540-9699-991404bd177a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 succeeded Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG cinder.volume.drivers.quobyte [None req-42287c28-0b86-4540-9699-991404bd177a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=93821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG oslo_concurrency.lockutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.372s {{(pid=93821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG oslo_concurrency.processutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=93821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:10:34 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:10:34 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:10:34 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG oslo_concurrency.processutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.228s {{(pid=93821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:10:34 devstack cinder-volume[93821]: INFO cinder.volume.driver [None req-42287c28-0b86-4540-9699-991404bd177a None None] Driver hasn't implemented _init_vendor_properties() Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG cinder.volume.driver [None req-42287c28-0b86-4540-9699-991404bd177a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.81400680542, 'free_capacity_gb': 1774.81400680542, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93821) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG oslo_db.sqlalchemy.engines [None req-42287c28-0b86-4540-9699-991404bd177a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93821) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG dbcounter [-] [93821] Writer thread running {{(pid=93821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG cinder.db.api [None req-42287c28-0b86-4540-9699-991404bd177a None None] Building query based on filter {{(pid=93821) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG cinder.image.image_utils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93821) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 16:10:34 devstack cinder-volume[93821]: INFO cinder.keymgr.migration [None req-171cd69a-c1ec-45fc-b472-fbbf8009985b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG oslo_concurrency.lockutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG oslo_concurrency.lockutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG cinder.volume.drivers.quobyte [None req-42287c28-0b86-4540-9699-991404bd177a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=93821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG cinder.volume.drivers.quobyte [None req-42287c28-0b86-4540-9699-991404bd177a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=93821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG oslo_concurrency.lockutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG oslo_concurrency.processutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=93821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:10:34 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:10:34 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:10:34 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG oslo_concurrency.processutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.219s {{(pid=93821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:10:34 devstack cinder-volume[93821]: DEBUG cinder.manager [None req-42287c28-0b86-4540-9699-991404bd177a None None] Notifying Schedulers of capabilities ... {{(pid=93821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:10:34 devstack cinder-volume[93821]: INFO cinder.volume.manager [None req-42287c28-0b86-4540-9699-991404bd177a None None] Driver initialization completed successfully. Aug 26 16:10:34 devstack cinder-volume[93821]: INFO cinder.manager [None req-42287c28-0b86-4540-9699-991404bd177a None None] Initiating service 3 cleanup Aug 26 16:10:35 devstack cinder-volume[93821]: INFO cinder.manager [None req-42287c28-0b86-4540-9699-991404bd177a None None] Service 3 cleanup completed. Aug 26 16:10:35 devstack cinder-volume[93821]: DEBUG cinder.service [None req-42287c28-0b86-4540-9699-991404bd177a None None] Creating RPC server for service cinder-volume {{(pid=93821) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 16:10:35 devstack cinder-volume[93821]: DEBUG cinder.service [None req-42287c28-0b86-4540-9699-991404bd177a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93821) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 16:10:35 devstack cinder-volume[93821]: INFO cinder.volume.manager [None req-42287c28-0b86-4540-9699-991404bd177a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 16:10:35 devstack cinder-volume[93821]: DEBUG oslo_concurrency.lockutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:10:35 devstack cinder-volume[93821]: DEBUG oslo_concurrency.lockutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:10:35 devstack cinder-volume[93821]: DEBUG cinder.volume.drivers.quobyte [None req-42287c28-0b86-4540-9699-991404bd177a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=93821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:10:35 devstack cinder-volume[93821]: DEBUG cinder.volume.drivers.quobyte [None req-42287c28-0b86-4540-9699-991404bd177a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=93821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:10:35 devstack cinder-volume[93821]: DEBUG oslo_concurrency.lockutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:10:35 devstack cinder-volume[93821]: DEBUG oslo_concurrency.processutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=93821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:10:35 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:10:35 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:10:35 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Aug 26 16:10:35 devstack cinder-volume[93821]: DEBUG oslo_concurrency.processutils [None req-42287c28-0b86-4540-9699-991404bd177a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.287s {{(pid=93821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:10:35 devstack cinder-volume[93821]: INFO cinder.volume.manager [None req-42287c28-0b86-4540-9699-991404bd177a None None] Driver post RPC initialization completed successfully. Aug 26 16:10:39 devstack cinder-volume[93600]: INFO oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Caught SIGTERM, stopping children Aug 26 16:10:39 devstack cinder-volume[93600]: DEBUG oslo_concurrency.lockutils [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Acquiring lock "singleton_lock" {{(pid=93600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 16:10:39 devstack cinder-volume[93600]: DEBUG oslo_concurrency.lockutils [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Acquired lock "singleton_lock" {{(pid=93600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 16:10:39 devstack cinder-volume[93600]: DEBUG oslo_concurrency.lockutils [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Releasing lock "singleton_lock" {{(pid=93600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 16:10:39 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Stop services. {{(pid=93600) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 16:10:39 devstack cinder-volume[93600]: DEBUG oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Killing children. {{(pid=93600) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 16:10:39 devstack cinder-volume[93600]: INFO oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Waiting on 1 children to exit Aug 26 16:10:42 devstack cinder-volume[93821]: DEBUG oslo_service.periodic_task [None req-ac20a154-f548-4837-a806-fd959ba857b0 None None] Running periodic task VolumeManager._thread_info {{(pid=93821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:10:42 devstack cinder-volume[93821]: DEBUG cinder.volume.manager [None req-ac20a154-f548-4837-a806-fd959ba857b0 None None] thread count: 6 {{(pid=93821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:10:42 devstack cinder-volume[93821]: DEBUG cinder.volume.manager [None req-ac20a154-f548-4837-a806-fd959ba857b0 None None] thread info: [<_MainThread(MainThread, started 131314403287168)>, , , , , ] {{(pid=93821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:10:43 devstack cinder-volume[93821]: DEBUG oslo_concurrency.lockutils [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Acquiring lock "singleton_lock" {{(pid=93821) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 16:10:43 devstack cinder-volume[93821]: DEBUG oslo_concurrency.lockutils [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Acquired lock "singleton_lock" {{(pid=93821) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 16:10:43 devstack cinder-volume[93821]: DEBUG oslo_concurrency.lockutils [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Releasing lock "singleton_lock" {{(pid=93821) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 16:10:43 devstack cinder-volume[93821]: WARNING amqp [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 16:10:43 devstack cinder-volume[93821]: WARNING amqp [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 16:10:43 devstack cinder-volume[93600]: INFO oslo_service.backend._eventlet.service [None req-a716e8c7-598c-4638-81f4-bfd9b2170efa None None] Child 93821 exited with status 0 Aug 26 16:10:43 devstack cinder-volume[94106]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 16:10:43 devstack cinder-volume[94106]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 16:10:43 devstack cinder-volume[94106]: we strongly recommend against using it for new projects. Aug 26 16:10:43 devstack cinder-volume[94106]: If you are already using Eventlet, we recommend migrating to a different Aug 26 16:10:43 devstack cinder-volume[94106]: framework. For more detail see Aug 26 16:10:43 devstack cinder-volume[94106]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 16:10:43 devstack cinder-volume[94106]: import eventlet # noqa Aug 26 16:10:46 devstack cinder-volume[94106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94106) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 16:10:46 devstack cinder-volume[94106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94106) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 16:10:46 devstack cinder-volume[94106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94106) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 16:10:46 devstack cinder-volume[94106]: INFO dbcounter [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] Registered counter for database cinder Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_db.sqlalchemy.engines [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94106) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG dbcounter [-] [94106] Writer thread running {{(pid=94106) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 16:10:47 devstack cinder-volume[94106]: INFO cinder.rpc [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 16:10:47 devstack cinder-volume[94106]: INFO cinder.rpc [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_db.sqlalchemy.engines [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94106) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 16:10:47 devstack cinder-volume[94106]: INFO cinder.volume.manager [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] Determined volume DB was empty at startup. Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG cinder.volume.manager [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94106) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 16:10:47 devstack cinder-volume[94106]: WARNING stevedore.named [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 16:10:47 devstack cinder-volume[94106]: WARNING castellan.key_manager [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 16:10:47 devstack cinder-volume[94106]: WARNING cinder.keymgr.conf_key_mgr [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 16:10:47 devstack cinder-volume[94106]: INFO cinder.volume.manager [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_db.sqlalchemy.engines [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94106) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 16:10:47 devstack cinder-volume[94106]: INFO oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] Starting 1 workers Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] Started child 94407 {{(pid=94106) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] Full set of CONF: {{(pid=94106) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] ******************************************************************************** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] Configuration options gathered from: {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] ================================================================================ {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] allow_availability_zone_fallback = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] allow_compression_on_image_upload = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] allowed_direct_url_schemes = [] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] api_rate_limit = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] auth_strategy = keystone {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_availability_zone = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_host = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_name = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_stats_polling_interval = 60 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backup_api_class = cinder.backup.api.API {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backup_name_template = backup-%s {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backup_use_same_host = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backup_use_temp_snapshot = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] chap_password = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] chap_username = {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cinder_internal_tenant_project_id = bb44a463019e4620adca334be1122011 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cinder_internal_tenant_user_id = ceb0076ec2484d07b930a9f6cf4645af {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cluster = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] compression_format = gzip {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] compute_api_class = cinder.compute.nova.API {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] config_dir = [] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] config_source = [] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] control_exchange = openstack {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] debug = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] default_availability_zone = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] default_group_type = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] default_volume_type = QuobyteHD {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94407]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] disk_geometry = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] driver_client_cert = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] driver_client_cert_key = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] driver_data_namespace = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] driver_ssl_cert_path = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] driver_ssl_cert_verify = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] driver_use_ssl = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] enable_new_services = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] enable_unsupported_driver = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] enabled_backends = ['QuobyteHD'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] enforce_multipath_for_image_xfer = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] filter_function = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance_api_insecure = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance_api_servers = ['http://192.168.122.244/image'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance_api_ssl_compression = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance_ca_certificates_file = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance_catalog_info = image:glance:publicURL {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance_certfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance_keyfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance_num_retries = 3 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance_request_timeout = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] goodness_function = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] graceful_shutdown_timeout = 5 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] group_api_class = cinder.group.api.API {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] host = devstack {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] image_compress_on_upload = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] image_conversion_address_space_limit = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] image_conversion_cpu_limit = 60 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] image_conversion_disable = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] image_upload_use_cinder_backend = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] image_upload_use_internal_tenant = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] image_volume_cache_enabled = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] image_volume_cache_max_count = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] image_volume_cache_max_size_gb = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] init_host_max_objects_retrieval = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] instance_format = [instance: %(uuid)s] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] iscsi_target_flags = {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] iscsi_write_cache = on {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] iser_helper = tgtadm {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] iser_ip_address = 192.168.122.244 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] iser_port = 3260 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] log_color = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] log_config_append = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] log_dir = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] log_file = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] log_options = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] log_rotate_interval = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] log_rotate_interval_type = days {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] log_rotation_type = none {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] max_age = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] max_logfile_count = 30 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] max_logfile_size_mb = 200 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] max_over_subscription_ratio = 20.0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] message_reap_interval = 86400 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] message_ttl = 2592000 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] migration_create_volume_timeout_secs = 300 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] monkey_patch = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] monkey_patch_modules = [] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] my_ip = 192.168.122.244 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] no_snapshot_gb_quota = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] num_iser_scan_tries = 3 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] num_shell_tries = 3 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] num_volume_device_scan_tries = 3 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] nvmeof_conn_info_version = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] nvmet_ns_id = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] nvmet_port_id = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] osapi_max_limit = 1000 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] osapi_volume_ext_list = [] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] osapi_volume_listen = 0.0.0.0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] osapi_volume_listen_port = 8776 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] osapi_volume_use_ssl = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] osapi_volume_workers = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] per_volume_size_limit = -1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] periodic_fuzzy_delay = 60 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] periodic_interval = 60 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] project_id_regex = [0-9a-f\-]+ {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] public_endpoint = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] publish_errors = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] quota_backup_gigabytes = 1000 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] quota_backups = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] quota_gigabytes = 1000 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] quota_groups = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] quota_snapshots = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] quota_volumes = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] rate_limit_burst = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] rate_limit_except_level = CRITICAL {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] rate_limit_interval = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] reinit_driver_count = 3 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] replication_device = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] report_discard_supported = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] report_interval = 120 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] reservation_clean_interval = 86400 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] reservation_expire = 86400 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] reserved_image_namespaces = [] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] reserved_percentage = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] rpc_response_timeout = 120 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] run_external_periodic_tasks = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] scst_target_driver = iscsi {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] scst_target_iqn_name = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] service_down_time = 720 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] shell_completion = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] snapshot_name_template = snapshot-%s {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] split_loggers = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] state_path = /opt/stack/data/cinder {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] storage_availability_zone = nova {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] storage_protocol = iSCSI {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] syslog_log_facility = LOG_USER {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] target_helper = lioadm {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] target_ip_address = 192.168.122.244 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] target_port = 3260 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] target_protocol = iscsi {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] target_secondary_ip_addresses = [] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] trace_flags = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] transfer_api_class = cinder.transfer.api.API {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] transport_url = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] until_refresh = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] use_chap_auth = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] use_default_quota_class = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] use_journal = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] use_json = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] use_multipath_for_image_xfer = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] use_stderr = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] use_syslog = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] verify_glance_signatures = enabled {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] volume_api_class = cinder.volume.api.API {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] volume_backend_name = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] volume_clear = zero {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] volume_clear_ionice = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] volume_clear_size = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] volume_copy_bps_limit = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] volume_dd_blocksize = 1M {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] volume_name_template = volume-%s {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] volume_service_inithost_offload = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] volume_usage_audit_period = month {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] zoning_mode = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_concurrency.disable_process_locking = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.auth_section = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 16:10:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94407) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.auth_type = password {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.auth_version = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.cache = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.certfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.delay_auth_decision = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.http_connect_timeout = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.include_service_catalog = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.insecure = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.interface = public {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.keyfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_password = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcache_username = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.region_name = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.service_token_roles_required = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.service_type = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.token_cache_time = 300 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.244/identity {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.backend = dogpile.cache.null {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.backend_argument = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.backend_expiration_time = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.config_prefix = cache.oslo {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.debug_cache_backend = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.enable_retry_client = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.enable_socket_keepalive = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.enabled = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.expiration_time = 600 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.hashclient_retry_attempts = 2 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.memcache_dead_retry = 300 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.memcache_pool_maxsize = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.memcache_sasl_enabled = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.password = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.proxies = [] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.redis_db = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.redis_sentinel_service_name = mymaster {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.redis_server = localhost:6379 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.retry_attempts = 2 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.retry_delay = 0.0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.socket_keepalive_count = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.socket_keepalive_idle = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.socket_keepalive_interval = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.socket_timeout = 1.0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.tls_allowed_ciphers = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.tls_cafile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.tls_certfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.tls_enabled = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.tls_keyfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cache.username = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] coordination.backend_url = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.asyncio_connection = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.asyncio_slave_connection = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.backend = sqlalchemy {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.connection = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.connection_debug = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.connection_parameters = {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.connection_recycle_time = 3600 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.connection_trace = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.db_inc_retry_interval = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.db_max_retries = 20 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.db_max_retry_interval = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.db_retry_interval = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.max_overflow = 50 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.max_pool_size = 5 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.max_retries = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.mysql_wsrep_sync_wait = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.pool_timeout = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.retry_interval = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.slave_connection = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.sqlite_synchronous = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.synchronous_reader = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] database.use_db_reconnect = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler.connection_string = messaging:// {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler.enabled = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler.es_doc_type = notification {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler.es_scroll_size = 10000 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler.es_scroll_time = 2m {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler.filter_error_trace = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler.hmac_keys = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler.sentinel_service_name = mymaster {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler.socket_timeout = 0.1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler.trace_requests = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler.trace_sqlalchemy = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler_jaeger.process_tags = {} {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler_jaeger.service_name_prefix = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] profiler_otlp.service_name_prefix = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_policy.enforce_new_defaults = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_policy.policy_default_rule = default {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_policy.policy_file = policy.yaml {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_policy.remote_timeout = 60.0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] privsep_osbrick.group = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] privsep_osbrick.helper_command = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] privsep_osbrick.user = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cinder_sys_admin.group = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cinder_sys_admin.helper_command = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] cinder_sys_admin.user = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] service_user.auth_section = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] service_user.auth_type = password {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] service_user.cafile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] service_user.certfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] service_user.collect_timing = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] service_user.insecure = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] service_user.keyfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] service_user.send_service_user_token = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] service_user.split_loggers = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] service_user.timeout = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance.auth_section = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance.auth_type = password {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance.certfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance.collect_timing = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance.insecure = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance.keyfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94407) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 16:10:47 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.quobyte [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance.region_name = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance.split_loggers = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] glance.timeout = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.backend_availability_zone = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.quobyte [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.chap_password = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.chap_username = {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Running cmd (subprocess): mount.quobyte {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.disk_geometry = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.driver_client_cert = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.driver_client_cert_key = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.driver_data_namespace = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.driver_use_ssl = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.enable_unsupported_driver = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.extra_capabilities = {} {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.filter_function = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.goodness_function = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.iscsi_target_flags = {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.iscsi_write_cache = on {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.iser_helper = tgtadm {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.iser_ip_address = 192.168.122.244 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.iser_port = 3260 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.nas_host = {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.nas_login = admin {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.nas_mount_options = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.nas_password = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.nas_private_key = {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.nas_share_path = {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.nas_ssh_port = 22 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.num_shell_tries = 3 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.nvmet_port_id = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.quobyte_client_cfg = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.quobyte_volume_url = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.replication_device = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.report_discard_supported = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.reserved_percentage = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.scst_target_driver = iscsi {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.scst_target_iqn_name = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.storage_protocol = iSCSI {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.target_helper = tgtadm {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.target_ip_address = 192.168.122.244 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.target_port = 3260 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.target_protocol = iscsi {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.trace_flags = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.unique_fqdn_network = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.use_chap_auth = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.volume_backend_name = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.volume_clear = zero {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.volume_clear_ionice = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.volume_clear_size = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_reports.file_event_handler = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_reports.log_dir = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.backend_availability_zone = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.backend_host = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.chap_password = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.chap_username = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.chiscsi_conf = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.disk_geometry = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.driver_client_cert = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.driver_client_cert_key = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.driver_data_namespace = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.driver_use_ssl = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.extra_capabilities = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.filter_function = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.goodness_function = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.iscsi_target_flags = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.iscsi_write_cache = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.iser_helper = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.iser_ip_address = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.iser_port = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.iser_target_prefix = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.nas_host = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.nas_login = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.nas_mount_options = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.nas_password = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.nas_private_key = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.nas_share_path = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.nas_ssh_port = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.num_shell_tries = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.nvmet_ns_id = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.nvmet_port_id = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.replication_device = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.report_discard_supported = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.reserved_percentage = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.scst_target_driver = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.storage_protocol = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.target_helper = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.target_ip_address = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack quobyte-client[94408]: Reading configuration file: /etc/quobyte/client.cfg Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.target_port = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.target_prefix = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.target_protocol = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.trace_flags = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack quobyte-client[94408]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.unique_fqdn_network = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.use_chap_auth = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.volume_clear = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.volume_clear_ionice = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.volume_clear_size = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] QuobyteHD.volumes_dir = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.ssl = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.ssl_version = {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_notifications.driver = [] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_notifications.retry = -1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] oslo_messaging_notifications.transport_url = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] key_manager.fixed_key = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.barbican_api_version = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.barbican_endpoint = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.barbican_endpoint_type = public {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.barbican_region_name = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.cafile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.certfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.collect_timing = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.insecure = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.keyfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.number_of_retries = 60 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.retry_delay = 1 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.send_service_user_token = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.split_loggers = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.timeout = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.verify_ssl = True {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican.verify_ssl_path = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican_service_user.auth_section = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican_service_user.auth_type = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican_service_user.cafile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican_service_user.certfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican_service_user.collect_timing = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican_service_user.insecure = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican_service_user.keyfile = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican_service_user.split_loggers = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] barbican_service_user.timeout = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.approle_role_id = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.approle_secret_id = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.auth_method = approle {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.auth_path = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.kv_mountpoint = secret {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.kv_path = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.kv_version = 2 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.namespace = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.root_token_id = **** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.ssl_ca_crt_file = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.timeout = 60.0 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.token_file = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.token_role = None {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.use_ssl = False {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 16:10:47 devstack cinder-volume[94106]: DEBUG oslo_service.backend._eventlet.service [None req-31b4883d-2d92-4df5-8156-199471e4fd1a None None] ******************************************************************************** {{(pid=94106) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 16:10:47 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:10:47 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:10:48 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.233s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:10:48 devstack cinder-volume[94407]: INFO cinder.volume.driver [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Driver hasn't implemented _init_vendor_properties() Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG cinder.volume.driver [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.81400680542, 'free_capacity_gb': 1774.81400680542, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94407) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG oslo_db.sqlalchemy.engines [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writer thread running {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG cinder.db.api [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Building query based on filter {{(pid=94407) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94407) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:10:48 devstack cinder-volume[94407]: INFO cinder.keymgr.migration [None req-344d8242-8dce-4a6b-a4cc-b91f79f8ae6b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 16:10:48 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:10:48 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:10:48 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.235s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:10:48 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Driver initialization completed successfully. Aug 26 16:10:48 devstack cinder-volume[94407]: INFO cinder.manager [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Initiating service 3 cleanup Aug 26 16:10:48 devstack cinder-volume[94407]: INFO cinder.manager [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Service 3 cleanup completed. Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG cinder.service [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Creating RPC server for service cinder-volume {{(pid=94407) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG cinder.service [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94407) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 16:10:48 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:10:48 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:10:48 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:10:48 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Aug 26 16:10:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.248s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:10:48 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a8ef2907-4a92-4618-8d0e-77003b884fdc None None] Driver post RPC initialization completed successfully. Aug 26 16:10:57 devstack cinder-volume[94106]: DEBUG dbcounter [-] [94106] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94106) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:10:58 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:10:58 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=3 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:11:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:11:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 6 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:11:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Flow 'volume_create_manager' (85f2dd60-181c-49e2-b85e-4e50cf544b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145ec23d-e41f-4887-9b2e-91b2eb5a0058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145ec23d-e41f-4887-9b2e-91b2eb5a0058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1272609806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2dd42d-7fab-4324-af5b-81b7d10ecd97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2c966041874614a15b5325284393ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:11:46Z,use_quota=True,user_id='f0eebfc4e2ec4278a500ce5fd083bd93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccd84fc-ea38-4562-84b8-a975cfd2128c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccd84fc-ea38-4562-84b8-a975cfd2128c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd779f9-504a-47b4-8ad0-3b0854ac477e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd779f9-504a-47b4-8ad0-3b0854ac477e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e2dd42d-7fab-4324-af5b-81b7d10ecd97', 'volume_name': 'volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfee959c-110f-4c7f-a003-4c503cd246e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfee959c-110f-4c7f-a003-4c503cd246e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9ee0b4-c5a2-4c07-83c0-496aa2a0f9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:11:45 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Volume 6e2dd42d-7fab-4324-af5b-81b7d10ecd97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97', 'volume_size': 1} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1272609806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2dd42d-7fab-4324-af5b-81b7d10ecd97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2c966041874614a15b5325284393ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:11:46Z,use_quota=True,user_id='f0eebfc4e2ec4278a500ce5fd083bd93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Creating volume 6e2dd42d-7fab-4324-af5b-81b7d10ecd97 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:11:45 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:11:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:11:45 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97 1073741824 Aug 26 16:11:45 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:11:46 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Aug 26 16:11:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97 1073741824" returned: 0 in 0.682s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:11:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:11:46 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97 Aug 26 16:11:46 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:11:46 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Aug 26 16:11:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97" returned: 0 in 0.273s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:11:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:11:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:11:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9ee0b4-c5a2-4c07-83c0-496aa2a0f9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:11:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0232bc-20d1-483c-9246-1d9f9b1b9b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:11:46 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Volume volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97 (6e2dd42d-7fab-4324-af5b-81b7d10ecd97): created successfully Aug 26 16:11:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0232bc-20d1-483c-9246-1d9f9b1b9b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:11:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Flow 'volume_create_manager' (85f2dd60-181c-49e2-b85e-4e50cf544b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:11:47 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b696388d-2645-4394-b610-89a1ae8ae8d6 tempest-TaggedAttachmentsTest-1545984373 None] Created volume successfully. Aug 26 16:11:57 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:11:57 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:12:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:12:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:12:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:12:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:12:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:12:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:12:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:17 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:12:17 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:18 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.693s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:12:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:12:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 6 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:12:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Flow 'volume_create_manager' (4f1965a7-eea8-405d-a78e-6550a491c7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6e66f4-a872-48ea-8374-8cdf5753331e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6e66f4-a872-48ea-8374-8cdf5753331e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1422249329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29861c68-1513-4ac7-aaf7-421d4fead5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a310a3d4e943caba68c8b40116bac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:12:23Z,use_quota=True,user_id='418bd5305d7d4dc6aa05522dd351a178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409bdc13-be2d-40f0-9917-44e822ec5d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409bdc13-be2d-40f0-9917-44e822ec5d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ba697f-710b-4d93-95b7-2a8968c4b788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ba697f-710b-4d93-95b7-2a8968c4b788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29861c68-1513-4ac7-aaf7-421d4fead5c4', 'volume_name': 'volume-29861c68-1513-4ac7-aaf7-421d4fead5c4', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816b9954-0506-40f7-a275-31183696c26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816b9954-0506-40f7-a275-31183696c26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37289a6-ef7a-4255-9126-750329a46fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:23 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Volume 29861c68-1513-4ac7-aaf7-421d4fead5c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29861c68-1513-4ac7-aaf7-421d4fead5c4', 'volume_size': 1} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1422249329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29861c68-1513-4ac7-aaf7-421d4fead5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a310a3d4e943caba68c8b40116bac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:12:23Z,use_quota=True,user_id='418bd5305d7d4dc6aa05522dd351a178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Creating volume 29861c68-1513-4ac7-aaf7-421d4fead5c4 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:12:23 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:12:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-29861c68-1513-4ac7-aaf7-421d4fead5c4 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:23 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-29861c68-1513-4ac7-aaf7-421d4fead5c4 1073741824 Aug 26 16:12:23 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:24 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-29861c68-1513-4ac7-aaf7-421d4fead5c4 1073741824" returned: 0 in 1.287s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-29861c68-1513-4ac7-aaf7-421d4fead5c4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:24 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-29861c68-1513-4ac7-aaf7-421d4fead5c4 Aug 26 16:12:24 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:25 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-29861c68-1513-4ac7-aaf7-421d4fead5c4" returned: 0 in 0.445s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:12:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:12:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37289a6-ef7a-4255-9126-750329a46fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29861c68-1513-4ac7-aaf7-421d4fead5c4', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78bd1e42-536f-4ce8-a470-c2ef552870ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:25 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Volume volume-29861c68-1513-4ac7-aaf7-421d4fead5c4 (29861c68-1513-4ac7-aaf7-421d4fead5c4): created successfully Aug 26 16:12:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78bd1e42-536f-4ce8-a470-c2ef552870ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Flow 'volume_create_manager' (4f1965a7-eea8-405d-a78e-6550a491c7e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:12:25 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-747a5c58-2463-46fd-a168-f9e6ce5823c2 tempest-VolumesAdminNegativeTest-1078877786 None] Created volume successfully. Aug 26 16:12:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Acquiring lock "cinder-29861c68-1513-4ac7-aaf7-421d4fead5c4-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:12:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Lock "cinder-29861c68-1513-4ac7-aaf7-421d4fead5c4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:12:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Acquiring lock "cinder-quobyte-29861c68-1513-4ac7-aaf7-421d4fead5c4" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:12:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Lock "cinder-quobyte-29861c68-1513-4ac7-aaf7-421d4fead5c4" acquired by "delete_volume" :: waited 0.052s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:12:27 devstack cinder-volume[94407]: INFO oslo.privsep.daemon [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprcvxnhj4/privsep.sock'] Aug 26 16:12:27 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprcvxnhj4/privsep.sock Aug 26 16:12:27 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:28 devstack cinder-volume[94407]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 26 16:12:28 devstack cinder-volume[94407]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 16:12:28 devstack cinder-volume[94407]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 26 16:12:28 devstack cinder-volume[94407]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 16:12:28 devstack cinder-volume[94407]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 26 16:12:28 devstack cinder-volume[94407]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 26 16:12:28 devstack cinder-volume[94407]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 16:12:28 devstack cinder-volume[94407]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 16:12:28 devstack cinder-volume[94407]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 26 16:12:29 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:29 devstack cinder-volume[94407]: INFO oslo.privsep.daemon [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Spawned new privsep daemon via rootwrap Aug 26 16:12:29 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Accepted privsep connection to /tmp/tmprcvxnhj4/privsep.sock {{(pid=94407) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 26 16:12:29 devstack cinder-volume[94407]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 26 16:12:29 devstack cinder-volume[94407]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 26 16:12:29 devstack cinder-volume[94407]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 26 16:12:29 devstack cinder-volume[94407]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95757 Aug 26 16:12:29 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a8a71d-df80-4067-a195-a626071e9da7]: (2,) {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:12:29 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[381212d4-e81a-4542-a4a2-edfe3cc52268]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:12:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-29861c68-1513-4ac7-aaf7-421d4fead5c4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:29 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-29861c68-1513-4ac7-aaf7-421d4fead5c4 Aug 26 16:12:29 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:30 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-29861c68-1513-4ac7-aaf7-421d4fead5c4" returned: 0 in 0.664s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-29861c68-1513-4ac7-aaf7-421d4fead5c4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:30 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-29861c68-1513-4ac7-aaf7-421d4fead5c4 Aug 26 16:12:30 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:30 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-29861c68-1513-4ac7-aaf7-421d4fead5c4" returned: 0 in 0.357s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:30 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Lock "cinder-quobyte-29861c68-1513-4ac7-aaf7-421d4fead5c4" released by "delete_volume" :: held 2.583s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:12:30 devstack cinder-volume[94407]: WARNING cinder.quota [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:12:30 devstack cinder-volume[94407]: WARNING cinder.quota [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:12:30 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Created reservations ['8f887761-1df3-4582-9885-85e9ce564800', 'b990932e-e3b2-4148-bc5b-6a59561e94b3', '725f81a1-3257-413e-abb1-97c65924e888', '463312ad-6b70-4efa-9713-ae64c5649967'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:12:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:12:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:12:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:12:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:12:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:12:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:30 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:12:30 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:30 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.309s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:30 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:12:30 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Deleted volume successfully. Aug 26 16:12:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c4e4ab63-b2c7-4bdf-804d-e4e763c9b196 tempest-VolumesAdminNegativeTest-1078877786 None] Lock "cinder-29861c68-1513-4ac7-aaf7-421d4fead5c4-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:12:31 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:12:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Flow 'volume_create_manager' (bee2555a-21b8-445c-b1a6-5131c7e0d844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:12:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d9e90f-056e-4c2e-984f-1b8a08848557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d9e90f-056e-4c2e-984f-1b8a08848557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-864218499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2d1912-c735-4406-9952-c75371700b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fe82fd79564a1493193b83ab4c9b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:12:32Z,use_quota=True,user_id='8337162c57ac4aaf80b4377233008bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be192f3b-209c-48ea-9ebf-22a506e2317d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be192f3b-209c-48ea-9ebf-22a506e2317d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3f922c-15f0-4e1a-b80d-04ae72c48c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3f922c-15f0-4e1a-b80d-04ae72c48c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2d1912-c735-4406-9952-c75371700b74', 'volume_name': 'volume-6b2d1912-c735-4406-9952-c75371700b74', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a5485a-4fd4-48c9-ad0d-d7be8b8f1d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a5485a-4fd4-48c9-ad0d-d7be8b8f1d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de995dd6-7ee0-4691-9af2-067066453ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:32 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Volume 6b2d1912-c735-4406-9952-c75371700b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2d1912-c735-4406-9952-c75371700b74', 'volume_size': 1} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-864218499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2d1912-c735-4406-9952-c75371700b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fe82fd79564a1493193b83ab4c9b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:12:32Z,use_quota=True,user_id='8337162c57ac4aaf80b4377233008bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Creating volume 6b2d1912-c735-4406-9952-c75371700b74 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:12:32 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6b2d1912-c735-4406-9952-c75371700b74 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:32 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6b2d1912-c735-4406-9952-c75371700b74 1073741824 Aug 26 16:12:32 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:32 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6b2d1912-c735-4406-9952-c75371700b74 1073741824" returned: 0 in 0.831s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6b2d1912-c735-4406-9952-c75371700b74 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:33 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6b2d1912-c735-4406-9952-c75371700b74 Aug 26 16:12:33 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:33 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6b2d1912-c735-4406-9952-c75371700b74" returned: 0 in 0.338s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:12:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:12:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de995dd6-7ee0-4691-9af2-067066453ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2d1912-c735-4406-9952-c75371700b74', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cad1774-4a70-4cf9-bf82-b39392e482c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:33 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Volume volume-6b2d1912-c735-4406-9952-c75371700b74 (6b2d1912-c735-4406-9952-c75371700b74): created successfully Aug 26 16:12:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cad1774-4a70-4cf9-bf82-b39392e482c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Flow 'volume_create_manager' (bee2555a-21b8-445c-b1a6-5131c7e0d844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:12:33 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0a9f70ef-5b5d-456c-b850-ce783167a266 tempest-ServersNegativeTestJSON-738459536 None] Created volume successfully. Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Flow 'volume_create_manager' (af5ba56d-5185-4d72-9987-e7f3fb12ff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a457e1a-c803-448b-94e4-41b30fc2e1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a457e1a-c803-448b-94e4-41b30fc2e1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-964528893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402fa353-c345-49d8-a39a-f1062640d3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fe82fd79564a1493193b83ab4c9b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:12:36Z,use_quota=True,user_id='8337162c57ac4aaf80b4377233008bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fa7586-15dc-4761-8740-26c111d3c95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fa7586-15dc-4761-8740-26c111d3c95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e423c2-1ffa-493b-a796-1b1c5943e937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e423c2-1ffa-493b-a796-1b1c5943e937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '402fa353-c345-49d8-a39a-f1062640d3bb', 'volume_name': 'volume-402fa353-c345-49d8-a39a-f1062640d3bb', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e14083-082e-40a0-a63b-54dc8080ffae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e14083-082e-40a0-a63b-54dc8080ffae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7600f5-a933-46fe-a110-f3d2c159c4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:36 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Volume 402fa353-c345-49d8-a39a-f1062640d3bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-402fa353-c345-49d8-a39a-f1062640d3bb', 'volume_size': 1} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-964528893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402fa353-c345-49d8-a39a-f1062640d3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fe82fd79564a1493193b83ab4c9b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:12:36Z,use_quota=True,user_id='8337162c57ac4aaf80b4377233008bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Creating volume 402fa353-c345-49d8-a39a-f1062640d3bb {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:12:36 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:12:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-402fa353-c345-49d8-a39a-f1062640d3bb 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:36 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-402fa353-c345-49d8-a39a-f1062640d3bb 1073741824 Aug 26 16:12:36 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:37 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-402fa353-c345-49d8-a39a-f1062640d3bb 1073741824" returned: 0 in 0.638s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-402fa353-c345-49d8-a39a-f1062640d3bb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:37 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-402fa353-c345-49d8-a39a-f1062640d3bb Aug 26 16:12:37 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:37 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-402fa353-c345-49d8-a39a-f1062640d3bb" returned: 0 in 0.372s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:12:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:12:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7600f5-a933-46fe-a110-f3d2c159c4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-402fa353-c345-49d8-a39a-f1062640d3bb', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2bfa33-6b00-4c1c-9f86-f7e1df3b595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:12:37 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Volume volume-402fa353-c345-49d8-a39a-f1062640d3bb (402fa353-c345-49d8-a39a-f1062640d3bb): created successfully Aug 26 16:12:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2bfa33-6b00-4c1c-9f86-f7e1df3b595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:12:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Flow 'volume_create_manager' (af5ba56d-5185-4d72-9987-e7f3fb12ff9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:12:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bab9fa5b-2965-49da-9aa3-17d59e3865f5 tempest-ServersNegativeTestJSON-738459536 None] Created volume successfully. Aug 26 16:12:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Acquiring lock "cinder-402fa353-c345-49d8-a39a-f1062640d3bb-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:12:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Lock "cinder-402fa353-c345-49d8-a39a-f1062640d3bb-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:12:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Acquiring lock "cinder-quobyte-402fa353-c345-49d8-a39a-f1062640d3bb" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:12:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Lock "cinder-quobyte-402fa353-c345-49d8-a39a-f1062640d3bb" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:12:41 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a63acf9-c01b-4450-b9d1-0f9cdf5af5a9]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:12:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-402fa353-c345-49d8-a39a-f1062640d3bb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:41 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-402fa353-c345-49d8-a39a-f1062640d3bb Aug 26 16:12:41 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:41 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-402fa353-c345-49d8-a39a-f1062640d3bb" returned: 0 in 0.521s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-402fa353-c345-49d8-a39a-f1062640d3bb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:42 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-402fa353-c345-49d8-a39a-f1062640d3bb Aug 26 16:12:42 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:42 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-402fa353-c345-49d8-a39a-f1062640d3bb" returned: 0 in 0.377s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Lock "cinder-quobyte-402fa353-c345-49d8-a39a-f1062640d3bb" released by "delete_volume" :: held 0.988s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Created reservations ['e60ee885-d26c-4ced-a073-10b9bf5ada39', '5b27f162-fda3-4d01-af80-94429108d69d', 'b1ba2444-483c-4a1f-b683-435530b36f5b', '6331a97b-a7a6-4974-88be-694e0268af40'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:42 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:12:42 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:42 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.267s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:12:42 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Deleted volume successfully. Aug 26 16:12:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4c30d4f2-366f-44c3-8a15-f15f6cffca56 tempest-ServersNegativeTestJSON-738459536 None] Lock "cinder-402fa353-c345-49d8-a39a-f1062640d3bb-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:12:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Acquiring lock "cinder-6b2d1912-c735-4406-9952-c75371700b74-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:12:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Lock "cinder-6b2d1912-c735-4406-9952-c75371700b74-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:12:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Acquiring lock "cinder-quobyte-6b2d1912-c735-4406-9952-c75371700b74" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:12:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Lock "cinder-quobyte-6b2d1912-c735-4406-9952-c75371700b74" acquired by "delete_volume" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:12:43 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[55203bbb-0dbf-49f4-b0bb-9d4e5d94c561]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:12:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6b2d1912-c735-4406-9952-c75371700b74 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:43 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6b2d1912-c735-4406-9952-c75371700b74 Aug 26 16:12:43 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:44 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6b2d1912-c735-4406-9952-c75371700b74" returned: 0 in 0.438s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6b2d1912-c735-4406-9952-c75371700b74 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:44 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6b2d1912-c735-4406-9952-c75371700b74 Aug 26 16:12:44 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:44 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6b2d1912-c735-4406-9952-c75371700b74" returned: 0 in 0.271s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Lock "cinder-quobyte-6b2d1912-c735-4406-9952-c75371700b74" released by "delete_volume" :: held 0.758s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Created reservations ['832db44e-1bb1-4dc0-a768-6278be51c054', '88956865-70c4-4c60-b515-45cc9778c67b', '8dc3b9f6-44f0-4e01-b86d-f573c9329d15', '4efa06c8-8a42-46b3-bfea-8be6b43ab900'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:12:44 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:12:44 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:12:44 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.291s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:12:44 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Deleted volume successfully. Aug 26 16:12:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0ce1e5be-df3a-4291-9dc6-164681f39a71 tempest-ServersNegativeTestJSON-738459536 None] Lock "cinder-6b2d1912-c735-4406-9952-c75371700b74-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:12:58 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=26,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=1 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:12:58 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=36,cinder:SELECT=17,cinder:DELETE=5,cinder:INSERT=10 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:13:02 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:13:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Flow 'volume_create_manager' (219e1d4c-0073-44d2-8ea9-50d98066ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e02106-e04c-4010-8016-707e06364fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e02106-e04c-4010-8016-707e06364fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1355090199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1e4e61-8406-4fb9-ad10-0a9cb55b622c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d760f4a98ea04bfb94be82fd7512361c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:03Z,use_quota=True,user_id='8ae627e9c3da4836bb509df938af06dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa51a4d-de05-4e99-9485-0c7ac493043e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa51a4d-de05-4e99-9485-0c7ac493043e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d1bedf-6b5a-42ba-9194-0c12411d68fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d1bedf-6b5a-42ba-9194-0c12411d68fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1e4e61-8406-4fb9-ad10-0a9cb55b622c', 'volume_name': 'volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbc4947-521b-4319-8239-f4bab54811d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbc4947-521b-4319-8239-f4bab54811d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed59dfa8-0a91-4b24-85a0-b50779345e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:03 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Volume dc1e4e61-8406-4fb9-ad10-0a9cb55b622c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c', 'volume_size': 1} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1355090199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1e4e61-8406-4fb9-ad10-0a9cb55b622c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d760f4a98ea04bfb94be82fd7512361c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:03Z,use_quota=True,user_id='8ae627e9c3da4836bb509df938af06dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Creating volume dc1e4e61-8406-4fb9-ad10-0a9cb55b622c {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:13:03 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:13:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:03 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c 1073741824 Aug 26 16:13:03 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:04 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c 1073741824" returned: 0 in 1.107s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:04 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c Aug 26 16:13:04 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:04 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c" returned: 0 in 0.321s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:13:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed59dfa8-0a91-4b24-85a0-b50779345e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbd6a1b-92c2-4cc4-b602-94dbae6904c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:04 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Volume volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c (dc1e4e61-8406-4fb9-ad10-0a9cb55b622c): created successfully Aug 26 16:13:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbd6a1b-92c2-4cc4-b602-94dbae6904c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Flow 'volume_create_manager' (219e1d4c-0073-44d2-8ea9-50d98066ec76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:04 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-61c1b7b0-aa9d-4b35-8b1b-d2b0968dfd14 tempest-VolumesTestJSON-220501221 None] Created volume successfully. Aug 26 16:13:05 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:13:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Flow 'volume_create_manager' (e0aa380f-0830-4ee6-9dbb-436b86c1b5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a27dbe7-202a-473f-8748-5c91f6464f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a27dbe7-202a-473f-8748-5c91f6464f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1118354158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20886fea-9e48-4753-aa58-b272ca06a6eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d760f4a98ea04bfb94be82fd7512361c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:06Z,use_quota=True,user_id='8ae627e9c3da4836bb509df938af06dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07168c8-8b9e-40b5-b2d4-8a00895ef491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07168c8-8b9e-40b5-b2d4-8a00895ef491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5d5e07-273c-4424-bb0c-a7844d047d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5d5e07-273c-4424-bb0c-a7844d047d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20886fea-9e48-4753-aa58-b272ca06a6eb', 'volume_name': 'volume-20886fea-9e48-4753-aa58-b272ca06a6eb', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05a89d5-6f3a-4201-986f-8e3e98b0c476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05a89d5-6f3a-4201-986f-8e3e98b0c476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8493efd1-63d6-40e9-bde1-0e1e713cb998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:06 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Volume 20886fea-9e48-4753-aa58-b272ca06a6eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20886fea-9e48-4753-aa58-b272ca06a6eb', 'volume_size': 1} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1118354158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20886fea-9e48-4753-aa58-b272ca06a6eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d760f4a98ea04bfb94be82fd7512361c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:06Z,use_quota=True,user_id='8ae627e9c3da4836bb509df938af06dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Creating volume 20886fea-9e48-4753-aa58-b272ca06a6eb {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:13:06 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20886fea-9e48-4753-aa58-b272ca06a6eb 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:06 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20886fea-9e48-4753-aa58-b272ca06a6eb 1073741824 Aug 26 16:13:06 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:06 devstack cinder-volume[94407]: WARNING py.warnings [req-9736a7ea-a255-4806-aa03-cc4c4a6f971d req-92c0eef4-b3ba-4382-8624-630569148bdc tempest-TaggedAttachmentsTest-1545984373 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 26 16:13:06 devstack cinder-volume[94407]: .first() Aug 26 16:13:06 devstack cinder-volume[94407]: Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-9736a7ea-a255-4806-aa03-cc4c4a6f971d req-92c0eef4-b3ba-4382-8624-630569148bdc tempest-TaggedAttachmentsTest-1545984373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:06 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20886fea-9e48-4753-aa58-b272ca06a6eb 1073741824" returned: 0 in 0.574s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20886fea-9e48-4753-aa58-b272ca06a6eb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:06 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20886fea-9e48-4753-aa58-b272ca06a6eb Aug 26 16:13:06 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:07 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20886fea-9e48-4753-aa58-b272ca06a6eb" returned: 0 in 0.279s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:13:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-9736a7ea-a255-4806-aa03-cc4c4a6f971d req-92c0eef4-b3ba-4382-8624-630569148bdc tempest-TaggedAttachmentsTest-1545984373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.813s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-9736a7ea-a255-4806-aa03-cc4c4a6f971d req-92c0eef4-b3ba-4382-8624-630569148bdc tempest-TaggedAttachmentsTest-1545984373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8493efd1-63d6-40e9-bde1-0e1e713cb998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20886fea-9e48-4753-aa58-b272ca06a6eb', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fca82e5-ac7f-4c0f-ae28-753b8bc879ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:07 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Volume volume-20886fea-9e48-4753-aa58-b272ca06a6eb (20886fea-9e48-4753-aa58-b272ca06a6eb): created successfully Aug 26 16:13:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fca82e5-ac7f-4c0f-ae28-753b8bc879ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Flow 'volume_create_manager' (e0aa380f-0830-4ee6-9dbb-436b86c1b5f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-9736a7ea-a255-4806-aa03-cc4c4a6f971d req-92c0eef4-b3ba-4382-8624-630569148bdc tempest-TaggedAttachmentsTest-1545984373 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b954408a-4d4c-440c-a118-e60fad8dea70', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:13:07 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bc62a257-52f9-41fb-a51b-1e3b16bb6ba5 tempest-VolumesTestJSON-220501221 None] Created volume successfully. Aug 26 16:13:07 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-9736a7ea-a255-4806-aa03-cc4c4a6f971d req-92c0eef4-b3ba-4382-8624-630569148bdc tempest-TaggedAttachmentsTest-1545984373 None] attachment_update completed successfully. Aug 26 16:13:08 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:13:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Flow 'volume_create_manager' (72dab6f0-0d35-4069-a510-4bef7622789d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4377d8-a8c3-4ce1-b841-6a8abb0d3c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4377d8-a8c3-4ce1-b841-6a8abb0d3c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1610766438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e934f55-e14e-45cb-9278-3f71f049d24f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d760f4a98ea04bfb94be82fd7512361c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:09Z,use_quota=True,user_id='8ae627e9c3da4836bb509df938af06dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34aa7732-d24f-4f5b-bf44-0e19d1d6c62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34aa7732-d24f-4f5b-bf44-0e19d1d6c62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07012653-2619-486e-883a-1926aa184000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07012653-2619-486e-883a-1926aa184000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e934f55-e14e-45cb-9278-3f71f049d24f', 'volume_name': 'volume-1e934f55-e14e-45cb-9278-3f71f049d24f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4647b5-3587-4ea8-971c-d5b03e97836c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4647b5-3587-4ea8-971c-d5b03e97836c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549f6495-795e-4525-9ace-50f9b2bdcb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:09 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Volume 1e934f55-e14e-45cb-9278-3f71f049d24f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e934f55-e14e-45cb-9278-3f71f049d24f', 'volume_size': 1} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1610766438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e934f55-e14e-45cb-9278-3f71f049d24f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d760f4a98ea04bfb94be82fd7512361c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:09Z,use_quota=True,user_id='8ae627e9c3da4836bb509df938af06dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Creating volume 1e934f55-e14e-45cb-9278-3f71f049d24f {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:13:09 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1e934f55-e14e-45cb-9278-3f71f049d24f 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:09 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1e934f55-e14e-45cb-9278-3f71f049d24f 1073741824 Aug 26 16:13:09 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:09 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1e934f55-e14e-45cb-9278-3f71f049d24f 1073741824" returned: 0 in 0.693s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1e934f55-e14e-45cb-9278-3f71f049d24f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:09 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1e934f55-e14e-45cb-9278-3f71f049d24f Aug 26 16:13:09 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:10 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1e934f55-e14e-45cb-9278-3f71f049d24f" returned: 0 in 0.303s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:13:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549f6495-795e-4525-9ace-50f9b2bdcb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e934f55-e14e-45cb-9278-3f71f049d24f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515ff0f7-8433-4b06-a379-6a62dc9796fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:10 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Volume volume-1e934f55-e14e-45cb-9278-3f71f049d24f (1e934f55-e14e-45cb-9278-3f71f049d24f): created successfully Aug 26 16:13:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515ff0f7-8433-4b06-a379-6a62dc9796fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Flow 'volume_create_manager' (72dab6f0-0d35-4069-a510-4bef7622789d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:10 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-3b1fc390-a96b-4f0f-b9f1-dd056f321a07 tempest-VolumesTestJSON-220501221 None] Created volume successfully. Aug 26 16:13:11 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-f8bd3f9e-7afe-44c4-848a-5f2ad6cfc79e req-3c778c80-3464-4e25-bab6-1583b3d64ad8 tempest-TaggedAttachmentsTest-1545984373 None] Terminate volume connection completed successfully. Aug 26 16:13:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-f8bd3f9e-7afe-44c4-848a-5f2ad6cfc79e req-3c778c80-3464-4e25-bab6-1583b3d64ad8 tempest-TaggedAttachmentsTest-1545984373 None] Deleting attachment b954408a-4d4c-440c-a118-e60fad8dea70. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:13:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Acquiring lock "cinder-1e934f55-e14e-45cb-9278-3f71f049d24f-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Lock "cinder-1e934f55-e14e-45cb-9278-3f71f049d24f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Acquiring lock "cinder-quobyte-1e934f55-e14e-45cb-9278-3f71f049d24f" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Lock "cinder-quobyte-1e934f55-e14e-45cb-9278-3f71f049d24f" acquired by "delete_volume" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:12 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f175240-1bfc-4e83-88de-f940adab6118]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:13:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1e934f55-e14e-45cb-9278-3f71f049d24f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:12 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1e934f55-e14e-45cb-9278-3f71f049d24f Aug 26 16:13:12 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:12 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1e934f55-e14e-45cb-9278-3f71f049d24f" returned: 0 in 0.574s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1e934f55-e14e-45cb-9278-3f71f049d24f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:13 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1e934f55-e14e-45cb-9278-3f71f049d24f Aug 26 16:13:13 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:13 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1e934f55-e14e-45cb-9278-3f71f049d24f" returned: 0 in 0.298s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Lock "cinder-quobyte-1e934f55-e14e-45cb-9278-3f71f049d24f" released by "delete_volume" :: held 0.926s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Created reservations ['990b62f3-7089-40fd-ab3c-a901dbd9de78', 'b19d9097-65a9-40fc-836a-086759175aaa', 'faf915de-8553-4426-82ab-4587d41c3d40', '33212eb6-0e6f-40d9-be22-74ddad0d990d'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:13 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:13:13 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:13 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.362s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:13:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Deleted volume successfully. Aug 26 16:13:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9e9bb4e2-2477-47ce-9759-a28ab18960cc tempest-VolumesTestJSON-220501221 None] Lock "cinder-1e934f55-e14e-45cb-9278-3f71f049d24f-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Acquiring lock "cinder-20886fea-9e48-4753-aa58-b272ca06a6eb-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Lock "cinder-20886fea-9e48-4753-aa58-b272ca06a6eb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Acquiring lock "cinder-quobyte-20886fea-9e48-4753-aa58-b272ca06a6eb" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Lock "cinder-quobyte-20886fea-9e48-4753-aa58-b272ca06a6eb" acquired by "delete_volume" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:14 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cf4d3b-31fa-475c-b647-1e1e1692d658]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:13:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20886fea-9e48-4753-aa58-b272ca06a6eb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:14 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20886fea-9e48-4753-aa58-b272ca06a6eb Aug 26 16:13:14 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:15 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20886fea-9e48-4753-aa58-b272ca06a6eb" returned: 0 in 0.532s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20886fea-9e48-4753-aa58-b272ca06a6eb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:15 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20886fea-9e48-4753-aa58-b272ca06a6eb Aug 26 16:13:15 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:15 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20886fea-9e48-4753-aa58-b272ca06a6eb" returned: 0 in 0.427s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Lock "cinder-quobyte-20886fea-9e48-4753-aa58-b272ca06a6eb" released by "delete_volume" :: held 1.025s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:15 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Created reservations ['a8afcd46-1c0d-4306-972f-c91bba302ceb', '9025399c-ac41-45d7-8172-c4416b387282', 'a5f3077c-0059-4979-ac6f-a003ac5cfe4c', '6b0bed13-f586-437b-8160-08d15284c5a6'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:13:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:15 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:13:15 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:16 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.311s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:16 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:13:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Deleted volume successfully. Aug 26 16:13:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-05ff5625-d8f8-4654-85a7-b4bd4f58be18 tempest-VolumesTestJSON-220501221 None] Lock "cinder-20886fea-9e48-4753-aa58-b272ca06a6eb-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Acquiring lock "cinder-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Lock "cinder-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Acquiring lock "cinder-quobyte-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Lock "cinder-quobyte-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c" acquired by "delete_volume" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:16 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8325835-c196-454b-b28d-242d3e8851ea]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:13:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:17 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c Aug 26 16:13:17 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:17 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c" returned: 0 in 0.645s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:17 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c Aug 26 16:13:17 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:13:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:17 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c" returned: 0 in 0.398s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:18 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:13:18 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Lock "cinder-quobyte-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c" released by "delete_volume" :: held 1.109s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:18 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Created reservations ['b1b9a6d5-d613-4294-ba0d-b226960d6866', '3137852c-23cb-4628-b41b-ec5f4e38f613', '74e984c0-df0e-4cdc-8e6c-5f457b638635', '03ecc2e1-b60e-41ba-bf76-64f79476cce9'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:13:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:18 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.581s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:13:18 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:13:18 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:18 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.421s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:13:18 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Deleted volume successfully. Aug 26 16:13:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ce27983-bf88-4f0e-9a96-c069639d25a1 tempest-VolumesTestJSON-220501221 None] Lock "cinder-dc1e4e61-8406-4fb9-ad10-0a9cb55b622c-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Acquiring lock "cinder-6e2dd42d-7fab-4324-af5b-81b7d10ecd97-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Lock "cinder-6e2dd42d-7fab-4324-af5b-81b7d10ecd97-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Acquiring lock "cinder-quobyte-6e2dd42d-7fab-4324-af5b-81b7d10ecd97" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Lock "cinder-quobyte-6e2dd42d-7fab-4324-af5b-81b7d10ecd97" acquired by "delete_volume" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:24 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fab293-de67-4484-960b-bc29ee088981]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:13:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:24 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97 Aug 26 16:13:24 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:25 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97" returned: 0 in 0.474s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:25 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97 Aug 26 16:13:25 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Flow 'volume_create_manager' (e7073313-c044-4b79-9a66-60021733a04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31755847-2c16-4194-b695-3dfc43e7e306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31755847-2c16-4194-b695-3dfc43e7e306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1061900069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0e2cf5-c0d6-4081-b819-29c5e265ceb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='734a00748bfe4f33b030e72e40d3b440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:25Z,use_quota=True,user_id='4e99025323564412b039786b9ee44463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8248bca5-44bf-45ee-b2c2-6992be494565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8248bca5-44bf-45ee-b2c2-6992be494565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cff202-151c-4cfa-9992-f565dd95e771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cff202-151c-4cfa-9992-f565dd95e771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c0e2cf5-c0d6-4081-b819-29c5e265ceb1', 'volume_name': 'volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de41804-b621-41ee-bd2f-a72c318cc5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de41804-b621-41ee-bd2f-a72c318cc5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a8082a-00e1-4296-ad5a-9404226179c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:25 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Volume 9c0e2cf5-c0d6-4081-b819-29c5e265ceb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1', 'volume_size': 1} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1061900069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0e2cf5-c0d6-4081-b819-29c5e265ceb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='734a00748bfe4f33b030e72e40d3b440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:25Z,use_quota=True,user_id='4e99025323564412b039786b9ee44463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Creating volume 9c0e2cf5-c0d6-4081-b819-29c5e265ceb1 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:13:25 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:25 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-d088d7d2-9d44-4593-9bf8-b4d06f01b0bb tempest-GroupSnapshotsV319Test-1751908756 None] Group tempest-GroupSnapshotsV319Test-Group-707250603: creating Aug 26 16:13:25 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1 1073741824 Aug 26 16:13:25 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:25 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6e2dd42d-7fab-4324-af5b-81b7d10ecd97" returned: 0 in 0.467s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Lock "cinder-quobyte-6e2dd42d-7fab-4324-af5b-81b7d10ecd97" released by "delete_volume" :: held 1.016s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:25 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-d088d7d2-9d44-4593-9bf8-b4d06f01b0bb tempest-GroupSnapshotsV319Test-1751908756 None] Group tempest-GroupSnapshotsV319Test-Group-707250603: created successfully Aug 26 16:13:25 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-d088d7d2-9d44-4593-9bf8-b4d06f01b0bb tempest-GroupSnapshotsV319Test-1751908756 None] Create group completed successfully. Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Created reservations ['b6ef4e44-7865-4f93-8b5f-e12907ca9f0c', 'edcbb44e-dd9d-4ceb-aa6a-fb3365176a1c', '700ab052-eafc-4d1a-a9b2-1243b56eb0db', '8efa314a-0aa5-45b8-bbdc-304c52f50f9e'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:26 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:13:26 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:26 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1 1073741824" returned: 0 in 0.702s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:26 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.336s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:26 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:13:26 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Deleted volume successfully. Aug 26 16:13:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:26 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1 Aug 26 16:13:26 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:26 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-81272553-38b8-458a-b100-381196a2d903 tempest-TaggedAttachmentsTest-1545984373 None] Lock "cinder-6e2dd42d-7fab-4324-af5b-81b7d10ecd97-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:26 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1" returned: 0 in 0.470s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:26 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:13:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a8082a-00e1-4296-ad5a-9404226179c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f748e65-3c8c-4f79-b591-7ef4cf6b9654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:26 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Volume volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1 (9c0e2cf5-c0d6-4081-b819-29c5e265ceb1): created successfully Aug 26 16:13:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f748e65-3c8c-4f79-b591-7ef4cf6b9654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Flow 'volume_create_manager' (e7073313-c044-4b79-9a66-60021733a04c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:26 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7af1eed2-df17-4f07-9214-b3b00f18b6a2 tempest-ServerActionsTestOtherA-1685579537 None] Created volume successfully. Aug 26 16:13:27 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:13:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Flow 'volume_create_manager' (7c07cab8-4560-4c07-9e26-285bb8d9ad1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae1f726-f795-40ec-9a3a-cdf68cc7787a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae1f726-f795-40ec-9a3a-cdf68cc7787a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1011350994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7fb5a2c6-d2da-47b8-9fb0-2279e96260af,host='devstack@QuobyteHD#QuobyteHD',id=16963aca-f600-4e37-b399-ed9fae70ce7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee39af2c269343d793ef846377aebc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:28Z,use_quota=True,user_id='0bbd2a15a6404635a5b227e9278e5e9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9a7f943-1bc0-406f-b251-d570167bc6cb),volume_type_id=a9a7f943-1bc0-406f-b251-d570167bc6cb)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7659e3-3c9f-41f8-bea7-59df734b1b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7659e3-3c9f-41f8-bea7-59df734b1b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d4244d-6500-4f22-b654-796f3d3fea6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d4244d-6500-4f22-b654-796f3d3fea6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16963aca-f600-4e37-b399-ed9fae70ce7c', 'volume_name': 'volume-16963aca-f600-4e37-b399-ed9fae70ce7c', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84fc018-0fc4-4798-814c-9f52c5aaf2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84fc018-0fc4-4798-814c-9f52c5aaf2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b3e9d9-a66e-4b42-aed2-9b6d4d21851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:27 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Volume 16963aca-f600-4e37-b399-ed9fae70ce7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16963aca-f600-4e37-b399-ed9fae70ce7c', 'volume_size': 1} Aug 26 16:13:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7fb5a2c6-d2da-47b8-9fb0-2279e96260af,created_at=2026-08-26T14:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1011350994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7fb5a2c6-d2da-47b8-9fb0-2279e96260af,host='devstack@QuobyteHD#QuobyteHD',id=16963aca-f600-4e37-b399-ed9fae70ce7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee39af2c269343d793ef846377aebc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:28Z,use_quota=True,user_id='0bbd2a15a6404635a5b227e9278e5e9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9a7f943-1bc0-406f-b251-d570167bc6cb),volume_type_id=a9a7f943-1bc0-406f-b251-d570167bc6cb)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Creating volume 16963aca-f600-4e37-b399-ed9fae70ce7c {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:13:28 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:28 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c 1073741824 Aug 26 16:13:28 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Flow 'volume_create_manager' (f0353409-6ca6-4eaf-a62b-e6b387d52f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950cc97d-8116-4953-91c3-eb5c219d847a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950cc97d-8116-4953-91c3-eb5c219d847a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1136297391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d7ac476-8c74-4519-a75f-55efa6528013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca50bf98ac0a4ca8964830a5dd3b5977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:28Z,use_quota=True,user_id='7e7104a72ef042baba06c05e73919156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7f8bff-0f63-48a2-b323-f18595f1a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7f8bff-0f63-48a2-b323-f18595f1a97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8a3081-6e1e-4d41-9385-e069c331c823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8a3081-6e1e-4d41-9385-e069c331c823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d7ac476-8c74-4519-a75f-55efa6528013', 'volume_name': 'volume-8d7ac476-8c74-4519-a75f-55efa6528013', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92a6734-b7f1-450b-b747-d5b7d610cad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92a6734-b7f1-450b-b747-d5b7d610cad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f820cc9-ae64-447c-8df1-fbd483f207eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:28 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Volume 8d7ac476-8c74-4519-a75f-55efa6528013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d7ac476-8c74-4519-a75f-55efa6528013', 'volume_size': 1} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:28 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c 1073741824" returned: 0 in 0.637s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:28 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c Aug 26 16:13:28 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:29 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c" returned: 0 in 0.338s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.870s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1136297391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d7ac476-8c74-4519-a75f-55efa6528013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca50bf98ac0a4ca8964830a5dd3b5977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:28Z,use_quota=True,user_id='7e7104a72ef042baba06c05e73919156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Creating volume 8d7ac476-8c74-4519-a75f-55efa6528013 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:13:29 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d7ac476-8c74-4519-a75f-55efa6528013 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b3e9d9-a66e-4b42-aed2-9b6d4d21851c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16963aca-f600-4e37-b399-ed9fae70ce7c', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:29 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d7ac476-8c74-4519-a75f-55efa6528013 1073741824 Aug 26 16:13:29 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e7982e-3660-4881-a397-a45e36f29609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:29 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Volume volume-16963aca-f600-4e37-b399-ed9fae70ce7c (16963aca-f600-4e37-b399-ed9fae70ce7c): created successfully Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e7982e-3660-4881-a397-a45e36f29609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Flow 'volume_create_manager' (7c07cab8-4560-4c07-9e26-285bb8d9ad1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:29 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-500b22bc-8db2-4eed-9bfc-cf61e80e23ad tempest-GroupSnapshotsV319Test-1751908756 None] Created volume successfully. Aug 26 16:13:29 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d7ac476-8c74-4519-a75f-55efa6528013 1073741824" returned: 0 in 0.566s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d7ac476-8c74-4519-a75f-55efa6528013 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:29 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d7ac476-8c74-4519-a75f-55efa6528013 Aug 26 16:13:29 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:30 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d7ac476-8c74-4519-a75f-55efa6528013" returned: 0 in 0.344s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:13:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f820cc9-ae64-447c-8df1-fbd483f207eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d7ac476-8c74-4519-a75f-55efa6528013', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a22352-8f94-4a83-b2c2-ebdebdc52ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:30 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Volume volume-8d7ac476-8c74-4519-a75f-55efa6528013 (8d7ac476-8c74-4519-a75f-55efa6528013): created successfully Aug 26 16:13:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a22352-8f94-4a83-b2c2-ebdebdc52ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Flow 'volume_create_manager' (f0353409-6ca6-4eaf-a62b-e6b387d52f65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:30 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-98030159-f969-4d95-8fa0-8cee15174ed8 tempest-DeleteServersTestJSON-1910835425 None] Created volume successfully. Aug 26 16:13:30 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] GroupSnapshot 7a277601-3f93-4b50-bc0a-bb2813f1135e: creating. Aug 26 16:13:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] Group snapshot 7a277601-3f93-4b50-bc0a-bb2813f1135e: creating. {{(pid=94407) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 16:13:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] Creating offline snapshot 1eb00a61-0f77-49c8-88b4-6664a5d51dd4 of volume 16963aca-f600-4e37-b399-ed9fae70ce7c {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:13:30 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[692df51e-a507-4f0d-b2ab-478630769bd7]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:13:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:31 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c Aug 26 16:13:31 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:31 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c" returned: 0 in 0.745s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:31 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 1G Aug 26 16:13:31 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:32 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 1G" returned: 0 in 0.804s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16963aca-f600-4e37-b399-ed9fae70ce7c -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:32 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16963aca-f600-4e37-b399-ed9fae70ce7c -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 Aug 26 16:13:32 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:33 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16963aca-f600-4e37-b399-ed9fae70ce7c -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4" returned: 0 in 0.923s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:33 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:13:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:33 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 Aug 26 16:13:33 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-9a7e8a53-2b08-4f66-b5f4-7ae5688db8a2 req-00be9fd4-8389-4e66-a5cb-ccb355c452de tempest-DeleteServersTestJSON-1910835425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:33 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4" returned: 0 in 0.408s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:33 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.info Aug 26 16:13:33 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:34 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.info" returned: 0 in 0.482s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:34 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:13:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:34 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.info Aug 26 16:13:34 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:34 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.info" returned: 0 in 0.374s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.922s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-9a7e8a53-2b08-4f66-b5f4-7ae5688db8a2 req-00be9fd4-8389-4e66-a5cb-ccb355c452de tempest-DeleteServersTestJSON-1910835425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.282s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-9a7e8a53-2b08-4f66-b5f4-7ae5688db8a2 req-00be9fd4-8389-4e66-a5cb-ccb355c452de tempest-DeleteServersTestJSON-1910835425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-9a7e8a53-2b08-4f66-b5f4-7ae5688db8a2 req-00be9fd4-8389-4e66-a5cb-ccb355c452de tempest-DeleteServersTestJSON-1910835425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-8d7ac476-8c74-4519-a75f-55efa6528013', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4329a677-127c-4d2c-826a-94d9947ccc59', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:13:34 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-4fb2caf0-258b-4984-a2d9-3d6141b9dde5 tempest-GroupSnapshotsV319Test-1751908756 None] group_snapshot 7a277601-3f93-4b50-bc0a-bb2813f1135e: created successfully Aug 26 16:13:34 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-9a7e8a53-2b08-4f66-b5f4-7ae5688db8a2 req-00be9fd4-8389-4e66-a5cb-ccb355c452de tempest-DeleteServersTestJSON-1910835425 None] attachment_update completed successfully. Aug 26 16:13:36 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] group_snapshot 7a277601-3f93-4b50-bc0a-bb2813f1135e: deleting Aug 26 16:13:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] group_snapshot 7a277601-3f93-4b50-bc0a-bb2813f1135e: deleting {{(pid=94407) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 16:13:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Acquiring lock "cinder-quobyte-16963aca-f600-4e37-b399-ed9fae70ce7c" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Lock "cinder-quobyte-16963aca-f600-4e37-b399-ed9fae70ce7c" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Acquiring lock "cinder-quobyte-1eb00a61-0f77-49c8-88b4-6664a5d51dd4" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Lock "cinder-quobyte-1eb00a61-0f77-49c8-88b4-6664a5d51dd4" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Deleting offline snapshot 1eb00a61-0f77-49c8-88b4-6664a5d51dd4 of volume 16963aca-f600-4e37-b399-ed9fae70ce7c {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:13:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] snapshot_file for this snap is: volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:13:36 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d7347b-1706-4a07-b186-4eacb4767e91]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:13:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:36 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 Aug 26 16:13:36 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:37 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4" returned: 0 in 1.050s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16963aca-f600-4e37-b399-ed9fae70ce7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:13:37 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92042da-bde8-4d52-a01a-3f539ec00790]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:13:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:37 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c Aug 26 16:13:37 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:38 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c" returned: 0 in 0.709s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:38 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 Aug 26 16:13:38 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:38 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4" returned: 0 in 0.521s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:38 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4 Aug 26 16:13:38 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:39 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c.1eb00a61-0f77-49c8-88b4-6664a5d51dd4" returned: 0 in 0.507s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Lock "cinder-quobyte-1eb00a61-0f77-49c8-88b4-6664a5d51dd4" released by "_delete_snapshot" :: held 3.039s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Lock "cinder-quobyte-16963aca-f600-4e37-b399-ed9fae70ce7c" released by "delete_snapshot" :: held 3.095s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:39 devstack cinder-volume[94407]: WARNING cinder.quota [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1928937385 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1928937385, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:13:39 devstack cinder-volume[94407]: WARNING cinder.quota [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1928937385 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1928937385, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:13:39 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] Created reservations ['870ca8d7-3bd0-4e98-ac53-aa47b243edef', '5940e8ec-4015-4b8f-8c87-5bc41bd75b7c', 'b8a5405b-5576-44fb-a9be-5c6b81357ed8', 'd29c3a18-22e4-4313-a89c-a698a65d3fc5'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:13:39 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-51f7de20-978e-4093-b582-53ca341316b4 tempest-GroupSnapshotsV319Test-1751908756 None] group_snapshot 7a277601-3f93-4b50-bc0a-bb2813f1135e: deleted successfully Aug 26 16:13:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Acquiring lock "cinder-quobyte-16963aca-f600-4e37-b399-ed9fae70ce7c" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Lock "cinder-quobyte-16963aca-f600-4e37-b399-ed9fae70ce7c" acquired by "delete_volume" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:40 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[815e4f16-110b-4255-adf8-3abf207dcd0d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:13:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:40 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c Aug 26 16:13:40 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:40 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-34ff612d-40e3-47ab-b9aa-2ace3a5646f3 req-eb631c21-6699-4a71-b6da-738dd36e61a7 tempest-DeleteServersTestJSON-1910835425 None] Terminate volume connection completed successfully. Aug 26 16:13:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-34ff612d-40e3-47ab-b9aa-2ace3a5646f3 req-eb631c21-6699-4a71-b6da-738dd36e61a7 tempest-DeleteServersTestJSON-1910835425 None] Deleting attachment 4329a677-127c-4d2c-826a-94d9947ccc59. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:13:41 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c" returned: 0 in 0.794s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:41 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c Aug 26 16:13:41 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:41 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-16963aca-f600-4e37-b399-ed9fae70ce7c" returned: 0 in 0.279s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Lock "cinder-quobyte-16963aca-f600-4e37-b399-ed9fae70ce7c" released by "delete_volume" :: held 1.206s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:41 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Created reservations ['f19ea536-3afb-444c-9979-509c830e183c'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:13:41 devstack cinder-volume[94407]: WARNING cinder.quota [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1928937385 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1928937385, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:13:41 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Created reservations ['15d57860-a1ad-4632-8181-299fc2dd2f1d', '39d80a6f-9a20-431b-8322-acad1000a35e', '4240f4d7-46ef-4415-9258-a34c4fddd784', 'cff9c1f2-4b29-4d0b-bfda-4c4d34e99421'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:13:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:41 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:13:41 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:42 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.562s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:42 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:13:42 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8156455f-5323-4cea-99dc-4c73e1d25f4f tempest-GroupSnapshotsV319Test-1751908756 None] Delete group completed successfully. Aug 26 16:13:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Acquiring lock "cinder-8d7ac476-8c74-4519-a75f-55efa6528013-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Lock "cinder-8d7ac476-8c74-4519-a75f-55efa6528013-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Acquiring lock "cinder-quobyte-8d7ac476-8c74-4519-a75f-55efa6528013" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Lock "cinder-quobyte-8d7ac476-8c74-4519-a75f-55efa6528013" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:42 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[988b927a-45e6-4787-9de5-cf79be07c883]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:13:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d7ac476-8c74-4519-a75f-55efa6528013 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:42 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d7ac476-8c74-4519-a75f-55efa6528013 Aug 26 16:13:42 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:43 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d7ac476-8c74-4519-a75f-55efa6528013" returned: 0 in 0.599s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d7ac476-8c74-4519-a75f-55efa6528013 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:43 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d7ac476-8c74-4519-a75f-55efa6528013 Aug 26 16:13:43 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:43 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d7ac476-8c74-4519-a75f-55efa6528013" returned: 0 in 0.507s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Lock "cinder-quobyte-8d7ac476-8c74-4519-a75f-55efa6528013" released by "delete_volume" :: held 1.171s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:44 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Created reservations ['5e0608a1-6df9-4cce-8bf0-e45e3e7f7e75', '33675928-904e-4682-828b-7455d22ad518', 'd841ffc9-2549-4439-a523-27163c7e2170', '92fea38f-f329-4c55-bb9f-0dbd1b21147d'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:13:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:44 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:13:44 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:44 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.274s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:44 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:13:44 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Deleted volume successfully. Aug 26 16:13:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3d639024-23b3-4835-96bf-4d8351d15073 tempest-DeleteServersTestJSON-1910835425 None] Lock "cinder-8d7ac476-8c74-4519-a75f-55efa6528013-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e7ec6064-39c9-42d7-913d-05a5e883ecd6 tempest-GroupsTest-59538865 None] Group tempest-Group1-628655279: creating Aug 26 16:13:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e7ec6064-39c9-42d7-913d-05a5e883ecd6 tempest-GroupsTest-59538865 None] Group tempest-Group1-628655279: created successfully Aug 26 16:13:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e7ec6064-39c9-42d7-913d-05a5e883ecd6 tempest-GroupsTest-59538865 None] Create group completed successfully. Aug 26 16:13:53 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-02f71911-cf21-4cf3-b89b-2872a98bb213 tempest-GroupsTest-59538865 None] Group tempest-Group2-1341419060: creating Aug 26 16:13:53 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-02f71911-cf21-4cf3-b89b-2872a98bb213 tempest-GroupsTest-59538865 None] Group tempest-Group2-1341419060: created successfully Aug 26 16:13:53 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-02f71911-cf21-4cf3-b89b-2872a98bb213 tempest-GroupsTest-59538865 None] Create group completed successfully. Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Flow 'volume_create_manager' (bb3b839a-075f-45a8-950f-9934233a7569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27c3a98-3773-43bc-bd70-5094b4701fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27c3a98-3773-43bc-bd70-5094b4701fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2001524590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97ea6d49-887c-4802-964a-034385940de1,host='devstack@QuobyteHD#QuobyteHD',id=bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dc1566e0d44decae281d65c25b3cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:55Z,use_quota=True,user_id='4d07383f5b5a474f88fb0f7f7861d2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(538237ed-ccae-477e-8f4f-0798b4d9129f),volume_type_id=538237ed-ccae-477e-8f4f-0798b4d9129f)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86b7f50-7be2-4b2e-b018-3a525d5e168c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86b7f50-7be2-4b2e-b018-3a525d5e168c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d684cc-0a43-4221-8801-6a18ff0641bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d684cc-0a43-4221-8801-6a18ff0641bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce', 'volume_name': 'volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ff8ae7-ad2a-47ab-aa55-96d62c17faf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ff8ae7-ad2a-47ab-aa55-96d62c17faf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0791719b-f8f0-4177-bdf0-3a36477c073f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:54 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Volume bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce', 'volume_size': 1} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=97ea6d49-887c-4802-964a-034385940de1,created_at=2026-08-26T14:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2001524590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97ea6d49-887c-4802-964a-034385940de1,host='devstack@QuobyteHD#QuobyteHD',id=bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dc1566e0d44decae281d65c25b3cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:13:55Z,use_quota=True,user_id='4d07383f5b5a474f88fb0f7f7861d2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(538237ed-ccae-477e-8f4f-0798b4d9129f),volume_type_id=538237ed-ccae-477e-8f4f-0798b4d9129f)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Creating volume bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:13:54 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:13:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:54 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce 1073741824 Aug 26 16:13:54 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:55 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce 1073741824" returned: 0 in 0.585s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:55 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce Aug 26 16:13:55 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:55 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce" returned: 0 in 0.318s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:13:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0791719b-f8f0-4177-bdf0-3a36477c073f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe0d342-fa55-4376-acb8-58fc0d98b711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:13:55 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Volume volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce (bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce): created successfully Aug 26 16:13:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe0d342-fa55-4376-acb8-58fc0d98b711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:13:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Flow 'volume_create_manager' (bb3b839a-075f-45a8-950f-9934233a7569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:13:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-72cccef8-5912-46c0-9b54-183753c2c68a tempest-GroupsTest-59538865 None] Created volume successfully. Aug 26 16:13:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Acquiring lock "cinder-quobyte-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:13:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Lock "cinder-quobyte-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce" acquired by "delete_volume" :: waited 0.034s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:13:58 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eed4191-da0b-4edb-9ed8-51dc781c180f]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:13:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:58 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce Aug 26 16:13:58 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:58 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce" returned: 0 in 0.469s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:58 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce Aug 26 16:13:58 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:58 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce" returned: 0 in 0.323s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Lock "cinder-quobyte-bc67ff8f-c7c2-4418-bb89-ec0e1934c4ce" released by "delete_volume" :: held 0.856s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=81,cinder:SELECT=82,cinder:DELETE=6,cinder:INSERT=19 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Created reservations ['25ab5e0f-9f78-4539-99cc-e612b2e35d35'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=84,cinder:UPDATE=93,cinder:INSERT=19,cinder:DELETE=6 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:13:59 devstack cinder-volume[94407]: WARNING cinder.quota [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-385836225 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-385836225, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:13:59 devstack cinder-volume[94407]: WARNING cinder.quota [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-385836225 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-385836225, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Created reservations ['22ca464d-d724-442d-bc59-a125aca410f8', 'eb8bea66-3542-48b8-99c4-469adb030e4c', '31b245c9-d5cf-46c3-9a6a-c01face9dbbf', '00f2ef2a-83da-448a-85fe-dc418c903416'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:59 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:13:59 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:13:59 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-0d734d12-1b72-45dc-831a-90844d44fd06 tempest-GroupsTest-59538865 None] Created reservations ['68963996-9240-41e3-878b-5146e5b95d4c'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.414s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:13:59 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f7ec86d7-4de1-4f7a-bdae-9a34759d298d tempest-GroupsTest-59538865 None] Delete group completed successfully. Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0d734d12-1b72-45dc-831a-90844d44fd06 tempest-GroupsTest-59538865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0d734d12-1b72-45dc-831a-90844d44fd06 tempest-GroupsTest-59538865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0d734d12-1b72-45dc-831a-90844d44fd06 tempest-GroupsTest-59538865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0d734d12-1b72-45dc-831a-90844d44fd06 tempest-GroupsTest-59538865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0d734d12-1b72-45dc-831a-90844d44fd06 tempest-GroupsTest-59538865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:13:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0d734d12-1b72-45dc-831a-90844d44fd06 tempest-GroupsTest-59538865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:13:59 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:13:59 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:00 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0d734d12-1b72-45dc-831a-90844d44fd06 tempest-GroupsTest-59538865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.260s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:00 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-0d734d12-1b72-45dc-831a-90844d44fd06 tempest-GroupsTest-59538865 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:14:00 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0d734d12-1b72-45dc-831a-90844d44fd06 tempest-GroupsTest-59538865 None] Delete group completed successfully. Aug 26 16:14:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-00ebc68e-0ecb-4823-8e37-fbf72a8a4729 tempest-GroupsTest-59538865 None] Group tempest-GroupsTest-Group-582202903: creating Aug 26 16:14:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-00ebc68e-0ecb-4823-8e37-fbf72a8a4729 tempest-GroupsTest-59538865 None] Group tempest-GroupsTest-Group-582202903: created successfully Aug 26 16:14:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-00ebc68e-0ecb-4823-8e37-fbf72a8a4729 tempest-GroupsTest-59538865 None] Create group completed successfully. Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Flow 'volume_create_manager' (8640b47a-cb3d-43c9-94cb-d9a3abbaabf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d749ea4-7ab8-4840-b21e-935f8a8e0e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d749ea4-7ab8-4840-b21e-935f8a8e0e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-954395128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbcddb6d-c77a-46e9-9554-eb21800990b5,host='devstack@QuobyteHD#QuobyteHD',id=e91be758-d689-49f9-ba4b-37a793e7c34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dc1566e0d44decae281d65c25b3cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:14:03Z,use_quota=True,user_id='4d07383f5b5a474f88fb0f7f7861d2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1155f36-33c3-48d1-8deb-8a846ec94b68),volume_type_id=c1155f36-33c3-48d1-8deb-8a846ec94b68)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5827ae2b-4a41-41ac-ae58-7d781a0fae56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5827ae2b-4a41-41ac-ae58-7d781a0fae56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614e589b-ab19-4e2b-9cc1-10b40fba5abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614e589b-ab19-4e2b-9cc1-10b40fba5abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91be758-d689-49f9-ba4b-37a793e7c34d', 'volume_name': 'volume-e91be758-d689-49f9-ba4b-37a793e7c34d', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e04b8e-0b6c-4fea-a72a-68890438639f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e04b8e-0b6c-4fea-a72a-68890438639f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c690d2-fe9a-4b8e-9b73-196f39c54a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:03 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Volume e91be758-d689-49f9-ba4b-37a793e7c34d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91be758-d689-49f9-ba4b-37a793e7c34d', 'volume_size': 1} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cbcddb6d-c77a-46e9-9554-eb21800990b5,created_at=2026-08-26T14:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-954395128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbcddb6d-c77a-46e9-9554-eb21800990b5,host='devstack@QuobyteHD#QuobyteHD',id=e91be758-d689-49f9-ba4b-37a793e7c34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dc1566e0d44decae281d65c25b3cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:14:03Z,use_quota=True,user_id='4d07383f5b5a474f88fb0f7f7861d2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1155f36-33c3-48d1-8deb-8a846ec94b68),volume_type_id=c1155f36-33c3-48d1-8deb-8a846ec94b68)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Creating volume e91be758-d689-49f9-ba4b-37a793e7c34d {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:14:03 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e91be758-d689-49f9-ba4b-37a793e7c34d 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:03 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e91be758-d689-49f9-ba4b-37a793e7c34d 1073741824 Aug 26 16:14:03 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:03 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e91be758-d689-49f9-ba4b-37a793e7c34d 1073741824" returned: 0 in 0.489s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e91be758-d689-49f9-ba4b-37a793e7c34d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:03 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e91be758-d689-49f9-ba4b-37a793e7c34d Aug 26 16:14:03 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:04 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e91be758-d689-49f9-ba4b-37a793e7c34d" returned: 0 in 0.441s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:14:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:14:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c690d2-fe9a-4b8e-9b73-196f39c54a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91be758-d689-49f9-ba4b-37a793e7c34d', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45df494-95a3-4584-88a3-82d085240c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:04 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Volume volume-e91be758-d689-49f9-ba4b-37a793e7c34d (e91be758-d689-49f9-ba4b-37a793e7c34d): created successfully Aug 26 16:14:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45df494-95a3-4584-88a3-82d085240c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Flow 'volume_create_manager' (8640b47a-cb3d-43c9-94cb-d9a3abbaabf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:14:04 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-1df7ba0b-2471-4498-b415-7493ab40b30e tempest-GroupsTest-59538865 None] Created volume successfully. Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Flow 'volume_create_manager' (308696fc-7e02-4011-b827-4aba5155315c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd983b4e-bd77-446e-bb12-8c09b83a9161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd983b4e-bd77-446e-bb12-8c09b83a9161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-8557486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbcddb6d-c77a-46e9-9554-eb21800990b5,host='devstack@QuobyteHD#QuobyteHD',id=33bc127a-e3a8-4524-bf46-cb61ae0724e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dc1566e0d44decae281d65c25b3cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:14:05Z,use_quota=True,user_id='4d07383f5b5a474f88fb0f7f7861d2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1155f36-33c3-48d1-8deb-8a846ec94b68),volume_type_id=c1155f36-33c3-48d1-8deb-8a846ec94b68)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4d4dfb-d963-4dec-9012-ded9bcba7898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4d4dfb-d963-4dec-9012-ded9bcba7898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ee79ab-7a99-436f-b1ad-fb6704dfc744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ee79ab-7a99-436f-b1ad-fb6704dfc744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33bc127a-e3a8-4524-bf46-cb61ae0724e4', 'volume_name': 'volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ab71ca-a6f9-49cc-9d73-473abc8dd219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ab71ca-a6f9-49cc-9d73-473abc8dd219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156d9d93-1f92-450c-a045-799a8ecb585b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:05 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Volume 33bc127a-e3a8-4524-bf46-cb61ae0724e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4', 'volume_size': 1} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cbcddb6d-c77a-46e9-9554-eb21800990b5,created_at=2026-08-26T14:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-8557486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbcddb6d-c77a-46e9-9554-eb21800990b5,host='devstack@QuobyteHD#QuobyteHD',id=33bc127a-e3a8-4524-bf46-cb61ae0724e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dc1566e0d44decae281d65c25b3cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:14:05Z,use_quota=True,user_id='4d07383f5b5a474f88fb0f7f7861d2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1155f36-33c3-48d1-8deb-8a846ec94b68),volume_type_id=c1155f36-33c3-48d1-8deb-8a846ec94b68)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Creating volume 33bc127a-e3a8-4524-bf46-cb61ae0724e4 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:14:05 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:14:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:05 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4 1073741824 Aug 26 16:14:05 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:06 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4 1073741824" returned: 0 in 0.705s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:06 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4 Aug 26 16:14:06 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:06 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4" returned: 0 in 0.351s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:14:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:14:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156d9d93-1f92-450c-a045-799a8ecb585b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42f7028-43ed-4d51-ae71-a6a5b2b3357d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:06 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Volume volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4 (33bc127a-e3a8-4524-bf46-cb61ae0724e4): created successfully Aug 26 16:14:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42f7028-43ed-4d51-ae71-a6a5b2b3357d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Flow 'volume_create_manager' (308696fc-7e02-4011-b827-4aba5155315c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:14:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-47432c64-f47d-40d4-b45c-2499744d4c8a tempest-GroupsTest-59538865 None] Created volume successfully. Aug 26 16:14:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-ca002473-ef32-42c6-8e19-1791eef65ae9 req-f7403301-1a51-4013-863d-04925cbf1226 tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:14:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-ca002473-ef32-42c6-8e19-1791eef65ae9 req-f7403301-1a51-4013-863d-04925cbf1226 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:14:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-ca002473-ef32-42c6-8e19-1791eef65ae9 req-f7403301-1a51-4013-863d-04925cbf1226 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:14:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-ca002473-ef32-42c6-8e19-1791eef65ae9 req-f7403301-1a51-4013-863d-04925cbf1226 tempest-ServerActionsTestOtherA-1685579537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac53b3ac-0dae-44dd-b25f-2c77c422d7c6', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:14:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-ca002473-ef32-42c6-8e19-1791eef65ae9 req-f7403301-1a51-4013-863d-04925cbf1226 tempest-ServerActionsTestOtherA-1685579537 None] attachment_update completed successfully. Aug 26 16:14:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-65e79596-e8f1-45fe-a3d5-bc0f60bbb6ec tempest-GroupsTest-59538865 None] Update group completed successfully. Aug 26 16:14:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-cc88669e-ec3c-41a6-a6f2-70021ca11669 tempest-GroupsTest-59538865 None] Update group completed successfully. Aug 26 16:14:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Acquiring lock "cinder-quobyte-33bc127a-e3a8-4524-bf46-cb61ae0724e4" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:14:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Lock "cinder-quobyte-33bc127a-e3a8-4524-bf46-cb61ae0724e4" acquired by "delete_volume" :: waited 0.038s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:14:11 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b60adcf-b9c8-463c-bc53-51e9ce498544]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:14:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:11 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4 Aug 26 16:14:11 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:12 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4" returned: 0 in 0.719s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:12 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4 Aug 26 16:14:12 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-e2324012-81ca-4691-a338-3315e96418af req-88b9ac5f-25bf-46af-a1b9-adc99928aedd tempest-ServerActionsTestOtherA-1685579537 None] Terminate volume connection completed successfully. Aug 26 16:14:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-e2324012-81ca-4691-a338-3315e96418af req-88b9ac5f-25bf-46af-a1b9-adc99928aedd tempest-ServerActionsTestOtherA-1685579537 None] Deleting attachment ac53b3ac-0dae-44dd-b25f-2c77c422d7c6. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:14:13 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33bc127a-e3a8-4524-bf46-cb61ae0724e4" returned: 0 in 0.596s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Lock "cinder-quobyte-33bc127a-e3a8-4524-bf46-cb61ae0724e4" released by "delete_volume" :: held 1.388s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:14:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Acquiring lock "cinder-quobyte-e91be758-d689-49f9-ba4b-37a793e7c34d" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:14:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Lock "cinder-quobyte-e91be758-d689-49f9-ba4b-37a793e7c34d" acquired by "delete_volume" :: waited 0.032s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:14:13 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bacbea-7a6b-49a5-ace7-a5f98401ff5d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:14:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e91be758-d689-49f9-ba4b-37a793e7c34d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:13 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e91be758-d689-49f9-ba4b-37a793e7c34d Aug 26 16:14:13 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:13 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e91be758-d689-49f9-ba4b-37a793e7c34d" returned: 0 in 0.798s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e91be758-d689-49f9-ba4b-37a793e7c34d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:14 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e91be758-d689-49f9-ba4b-37a793e7c34d Aug 26 16:14:14 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:14 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e91be758-d689-49f9-ba4b-37a793e7c34d" returned: 0 in 0.719s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Lock "cinder-quobyte-e91be758-d689-49f9-ba4b-37a793e7c34d" released by "delete_volume" :: held 1.623s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:14:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-e2324012-81ca-4691-a338-3315e96418af req-ee14c0c9-40af-44a6-9c1c-c2dd2621ed8b tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:14:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-e2324012-81ca-4691-a338-3315e96418af req-ee14c0c9-40af-44a6-9c1c-c2dd2621ed8b tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:14:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-e2324012-81ca-4691-a338-3315e96418af req-ee14c0c9-40af-44a6-9c1c-c2dd2621ed8b tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:14:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-e2324012-81ca-4691-a338-3315e96418af req-ee14c0c9-40af-44a6-9c1c-c2dd2621ed8b tempest-ServerActionsTestOtherA-1685579537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c751f244-4a74-4b63-9f9b-bcc68c80eba4', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:14:14 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Created reservations ['eb6bd9f0-5915-4e0d-bc55-d724281fc855'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:14:15 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-e2324012-81ca-4691-a338-3315e96418af req-ee14c0c9-40af-44a6-9c1c-c2dd2621ed8b tempest-ServerActionsTestOtherA-1685579537 None] attachment_update completed successfully. Aug 26 16:14:15 devstack cinder-volume[94407]: WARNING cinder.quota [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-891919258 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-891919258, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:14:15 devstack cinder-volume[94407]: WARNING cinder.quota [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-891919258 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-891919258, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:14:15 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Created reservations ['0d407b9d-1651-4322-adc8-b38e23cbed57', '786d3cd5-0b70-427a-b738-ad5ba645d0fa', '1bce32b7-2a22-494e-803c-a79a0ceae7f0', 'cef0a768-3408-45d2-b756-1c33802e0ae8'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:14:15 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Created reservations ['d9533509-f0cb-4211-b652-e332400e1a35', '7b18b838-59cb-489f-aabd-f025537873b5', '43ca7bf5-763a-418a-953d-ef89fd8bb7f1', 'e2eb4d15-8772-4234-91c7-77b5545dcff1'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:14:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:14:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:14:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:14:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:14:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:14:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:15 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:14:15 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:15 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.382s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:15 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:14:15 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-009ec516-5177-4bf1-a739-eba174e5179b tempest-GroupsTest-59538865 None] Delete group completed successfully. Aug 26 16:14:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:14:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:14:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:14:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:14:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:14:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:14:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:17 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:14:17 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:18 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.388s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:14:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:14:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 8 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:14:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:14:25 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:INSERT=8,cinder:UPDATE=41,cinder:SELECT=41,cinder:DELETE=2 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:14:25 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=52,cinder:INSERT=8,cinder:UPDATE=44 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Flow 'volume_create_manager' (e5d7d916-fe9a-4b3b-b7de-c618fac5fbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66961103-f238-4478-85a0-c371ba9db0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66961103-f238-4478-85a0-c371ba9db0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-496939953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e85b7c2344d4ebeb55b88607b18af32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:14:39Z,use_quota=True,user_id='cad93d45ed254beda6ac3d2b31dcadf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993f0125-24cd-4d43-98d1-5eb9eb0ddee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993f0125-24cd-4d43-98d1-5eb9eb0ddee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be82148e-c0d3-4d57-ba23-6d3a0378942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be82148e-c0d3-4d57-ba23-6d3a0378942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491', 'volume_name': 'volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a29a1ff-da88-4fe4-ac33-c41734275116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a29a1ff-da88-4fe4-ac33-c41734275116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1453579-e5b3-4bce-b68a-8dd81e54086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:39 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Volume a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491', 'volume_size': 1} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-496939953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e85b7c2344d4ebeb55b88607b18af32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:14:39Z,use_quota=True,user_id='cad93d45ed254beda6ac3d2b31dcadf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Creating volume a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:14:39 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:14:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:39 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491 1073741824 Aug 26 16:14:39 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:40 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491 1073741824" returned: 0 in 0.729s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:40 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491 Aug 26 16:14:40 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:40 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491" returned: 0 in 0.303s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:14:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:14:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1453579-e5b3-4bce-b68a-8dd81e54086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eac8fc5-2978-4f58-936a-7d88e839233d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:40 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Volume volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491 (a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491): created successfully Aug 26 16:14:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eac8fc5-2978-4f58-936a-7d88e839233d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Flow 'volume_create_manager' (e5d7d916-fe9a-4b3b-b7de-c618fac5fbeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:14:40 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-32109220-a4f8-4609-9d4a-bfcb95db9f68 tempest-ServerRescueNegativeTestJSON-1917035801 None] Created volume successfully. Aug 26 16:14:50 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-13479d42-ae2e-4da9-9f88-e37db7aba869 req-3f8286b9-c55b-4364-aef0-f5932ebb7d05 tempest-ServerActionsTestOtherA-1685579537 None] Terminate volume connection completed successfully. Aug 26 16:14:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-13479d42-ae2e-4da9-9f88-e37db7aba869 req-3f8286b9-c55b-4364-aef0-f5932ebb7d05 tempest-ServerActionsTestOtherA-1685579537 None] Deleting attachment c751f244-4a74-4b63-9f9b-bcc68c80eba4. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:14:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Acquiring lock "cinder-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:14:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Lock "cinder-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:14:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Acquiring lock "cinder-quobyte-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:14:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Lock "cinder-quobyte-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491" acquired by "delete_volume" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:14:56 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[24254751-5d38-4f30-b85a-ccc2fd2d8f3c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:14:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:56 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491 Aug 26 16:14:56 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:57 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491" returned: 0 in 0.531s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:57 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491 Aug 26 16:14:57 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:57 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491" returned: 0 in 0.361s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Lock "cinder-quobyte-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491" released by "delete_volume" :: held 1.013s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:14:57 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Created reservations ['1b7f9506-cc10-40da-88c6-5e8d69972908', 'e735c04e-68d2-4dd7-8e9c-9c1f076c9bf9', 'ee899e87-a053-490b-8cd0-9d42e7b5c2da', 'f2350ba8-1e19-4082-ae2e-a0330a8480fb'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:14:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:14:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:14:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:14:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:14:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:14:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:57 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:14:57 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:58 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.363s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:58 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:14:58 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Deleted volume successfully. Aug 26 16:14:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a241d67c-ca21-47d4-bba4-47c7685db77d tempest-ServerRescueNegativeTestJSON-1917035801 None] Lock "cinder-a8f5af9a-a6ef-4ea4-9e09-8f13c6f50491-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:14:58 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:14:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Flow 'volume_create_manager' (6607678a-7ef3-44a8-9b3f-64bec6efdbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:14:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7edc0968-71bb-4045-a9a9-df56e82685fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7edc0968-71bb-4045-a9a9-df56e82685fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2135531648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776d4b5a-1808-4fac-a3a4-cb5af9281303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70aade55a3324a5cb76dd7943ff4201b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:14:59Z,use_quota=True,user_id='f93771470f954b80a77a73addb54074e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fec6da4-33dd-41b8-96ef-ae142511c971),volume_type_id=7fec6da4-33dd-41b8-96ef-ae142511c971)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7937c2de-25c7-4fa0-96cd-e4b83652fed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7937c2de-25c7-4fa0-96cd-e4b83652fed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83462a6e-8617-4455-869f-11d8ef5efcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83462a6e-8617-4455-869f-11d8ef5efcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '776d4b5a-1808-4fac-a3a4-cb5af9281303', 'volume_name': 'volume-776d4b5a-1808-4fac-a3a4-cb5af9281303', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdba985-11ce-422a-8ce6-740381a23c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdba985-11ce-422a-8ce6-740381a23c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5029e24-3f69-4807-8633-df7c779179d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:14:59 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Volume 776d4b5a-1808-4fac-a3a4-cb5af9281303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-776d4b5a-1808-4fac-a3a4-cb5af9281303', 'volume_size': 1} Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2135531648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776d4b5a-1808-4fac-a3a4-cb5af9281303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70aade55a3324a5cb76dd7943ff4201b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:14:59Z,use_quota=True,user_id='f93771470f954b80a77a73addb54074e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fec6da4-33dd-41b8-96ef-ae142511c971),volume_type_id=7fec6da4-33dd-41b8-96ef-ae142511c971)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Creating volume 776d4b5a-1808-4fac-a3a4-cb5af9281303 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:14:59 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-776d4b5a-1808-4fac-a3a4-cb5af9281303 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:14:59 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-776d4b5a-1808-4fac-a3a4-cb5af9281303 1073741824 Aug 26 16:14:59 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:14:59 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-776d4b5a-1808-4fac-a3a4-cb5af9281303 1073741824" returned: 0 in 0.832s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:14:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-776d4b5a-1808-4fac-a3a4-cb5af9281303 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:00 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-776d4b5a-1808-4fac-a3a4-cb5af9281303 Aug 26 16:15:00 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:00 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-776d4b5a-1808-4fac-a3a4-cb5af9281303" returned: 0 in 0.316s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:15:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5029e24-3f69-4807-8633-df7c779179d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-776d4b5a-1808-4fac-a3a4-cb5af9281303', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fb57f9-9378-40ee-9fa1-48f600cc7685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:00 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Volume volume-776d4b5a-1808-4fac-a3a4-cb5af9281303 (776d4b5a-1808-4fac-a3a4-cb5af9281303): created successfully Aug 26 16:15:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fb57f9-9378-40ee-9fa1-48f600cc7685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Flow 'volume_create_manager' (6607678a-7ef3-44a8-9b3f-64bec6efdbb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:15:00 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9c734919-8174-4ecb-a033-7168f2dc89ac tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Created volume successfully. Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Flow 'volume_create_manager' (28b24828-6c3f-45ca-9ef8-5bb9dbc3ae50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45951416-aaf5-4f72-bd32-f2f823581eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45951416-aaf5-4f72-bd32-f2f823581eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-135190125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40900bca-151b-4121-9987-23890ba28ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='734a00748bfe4f33b030e72e40d3b440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:15:02Z,use_quota=True,user_id='4e99025323564412b039786b9ee44463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79e0ed8-9984-4ff5-bb91-a82b53d43454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79e0ed8-9984-4ff5-bb91-a82b53d43454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2e7cab-3850-440f-a0c4-d09effae43e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG cinder.image.glance [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Creating Keystone auth plugin from conf {{(pid=94407) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e9b1f44d-641d-41de-8b4f-c6c4bf5e0abc tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e9b1f44d-641d-41de-8b4f-c6c4bf5e0abc tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1f44d-641d-41de-8b4f-c6c4bf5e0abc tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1f44d-641d-41de-8b4f-c6c4bf5e0abc tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e9b1f44d-641d-41de-8b4f-c6c4bf5e0abc tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e9b1f44d-641d-41de-8b4f-c6c4bf5e0abc tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:01 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:15:01 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:02 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e9b1f44d-641d-41de-8b4f-c6c4bf5e0abc tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.380s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:02 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-e9b1f44d-641d-41de-8b4f-c6c4bf5e0abc tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:15:02 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e9b1f44d-641d-41de-8b4f-c6c4bf5e0abc tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Retype volume completed successfully. Aug 26 16:15:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2e7cab-3850-440f-a0c4-d09effae43e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40900bca-151b-4121-9987-23890ba28ebc', 'volume_name': 'volume-40900bca-151b-4121-9987-23890ba28ebc', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c485f66-a407-4260-811e-30e58c4e939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c485f66-a407-4260-811e-30e58c4e939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642ea6ad-42a0-4a90-8843-32d19b007dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:02 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Volume 40900bca-151b-4121-9987-23890ba28ebc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40900bca-151b-4121-9987-23890ba28ebc', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 16:15:02 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Trying to clone 40900bca-151b-4121-9987-23890ba28ebc from image 6ac3a618-4ad2-4833-9626-12a425ebacfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]). {{(pid=94407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 16:15:02 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 16:15:02 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Image download 20.69 MB at 20.69 MB/s Aug 26 16:15:02 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[210dfd4b-eb5e-4bf9-9f82-6564bb00edb7]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:15:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Acquiring lock "cinder-776d4b5a-1808-4fac-a3a4-cb5af9281303-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:15:03 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD Aug 26 16:15:03 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Lock "cinder-776d4b5a-1808-4fac-a3a4-cb5af9281303-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Acquiring lock "cinder-quobyte-776d4b5a-1808-4fac-a3a4-cb5af9281303" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Lock "cinder-quobyte-776d4b5a-1808-4fac-a3a4-cb5af9281303" acquired by "delete_volume" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ad6630-3b70-4e70-bc16-1387b1a9e357]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-776d4b5a-1808-4fac-a3a4-cb5af9281303 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:03 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:03 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-776d4b5a-1808-4fac-a3a4-cb5af9281303 Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:03 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Temporary image 6ac3a618-4ad2-4833-9626-12a425ebacfd is fetched for user 4e99025323564412b039786b9ee44463. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5025cd7-7c33-4e76-bf90-ee62599c77e7]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:03 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD Aug 26 16:15:03 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:03 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-776d4b5a-1808-4fac-a3a4-cb5af9281303" returned: 0 in 0.511s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-776d4b5a-1808-4fac-a3a4-cb5af9281303 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:03 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-776d4b5a-1808-4fac-a3a4-cb5af9281303 Aug 26 16:15:03 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:03 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-135190125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40900bca-151b-4121-9987-23890ba28ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='734a00748bfe4f33b030e72e40d3b440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:15:02Z,use_quota=True,user_id='4e99025323564412b039786b9ee44463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Creating volume 40900bca-151b-4121-9987-23890ba28ebc {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:15:03 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:03 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc 1073741824 Aug 26 16:15:03 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:03 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-776d4b5a-1808-4fac-a3a4-cb5af9281303" returned: 0 in 0.266s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Lock "cinder-quobyte-776d4b5a-1808-4fac-a3a4-cb5af9281303" released by "delete_volume" :: held 0.830s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:15:04 devstack cinder-volume[94407]: WARNING cinder.quota [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:15:04 devstack cinder-volume[94407]: WARNING cinder.quota [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Created reservations ['16317eee-b840-4f7a-aa36-7385cddbe196', '3187f85f-29e9-44af-b97b-1b77fb916084', '4b2e1185-0426-492c-9295-8007f46a7818', '63a01e15-8553-4fb9-bd01-a324b1e876e8'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:04 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:15:04 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:04 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.276s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:15:04 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Deleted volume successfully. Aug 26 16:15:04 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc 1073741824" returned: 0 in 0.565s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ccb5e3bd-9faa-49c9-a688-4f9db7ca9207 tempest-VolumeRetypeWithoutMigrationTest-1916984271 None] Lock "cinder-776d4b5a-1808-4fac-a3a4-cb5af9281303-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:04 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc Aug 26 16:15:04 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:04 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc" returned: 0 in 0.248s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Attempting download of 6ac3a618-4ad2-4833-9626-12a425ebacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}])) to volume 40900bca-151b-4121-9987-23890ba28ebc. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af54543-371f-4629-a4a5-d5ab3b4c1111]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:15:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_wzstj_6t {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:04 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_wzstj_6t Aug 26 16:15:04 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:05 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_wzstj_6t" returned: 0 in 0.368s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_wzstj_6t {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:05 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_wzstj_6t Aug 26 16:15:05 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:05 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_wzstj_6t" returned: 1 in 0.377s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_wzstj_6t' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:15:05 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae0a1ef-9c34-4956-80a6-f99e604d0f14]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:15:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:05 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD Aug 26 16:15:05 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:05 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:05 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] 6ac3a618-4ad2-4833-9626-12a425ebacfd was qcow2, converting to qcow2 {{(pid=94407) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 16:15:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:05 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc Aug 26 16:15:05 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Flow 'volume_create_manager' (eb2dd3da-c781-44db-8fe0-5a7a54d4b01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc23b03-23c3-400c-8026-086d2f045dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc23b03-23c3-400c-8026-086d2f045dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1328885015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4303755b-2e83-4b2e-b128-87e2dd475572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9a71223ce74779831aa3e82057b9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:15:08Z,use_quota=True,user_id='e2cfe4685ba14e27b4814e8323f9f054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e62b4f-f1b2-4e54-a066-da78a4d7a7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e62b4f-f1b2-4e54-a066-da78a4d7a7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb731142-c1da-4ffc-a6d0-9bdc82e57bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb731142-c1da-4ffc-a6d0-9bdc82e57bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4303755b-2e83-4b2e-b128-87e2dd475572', 'volume_name': 'volume-4303755b-2e83-4b2e-b128-87e2dd475572', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e370eb6-633e-4a0a-9219-982c9c78f0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e370eb6-633e-4a0a-9219-982c9c78f0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e456313-b9cd-4c54-89c8-932feff705f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:07 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Volume 4303755b-2e83-4b2e-b128-87e2dd475572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4303755b-2e83-4b2e-b128-87e2dd475572', 'volume_size': 1} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1328885015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4303755b-2e83-4b2e-b128-87e2dd475572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9a71223ce74779831aa3e82057b9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:15:08Z,use_quota=True,user_id='e2cfe4685ba14e27b4814e8323f9f054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Creating volume 4303755b-2e83-4b2e-b128-87e2dd475572 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:15:07 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:15:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4303755b-2e83-4b2e-b128-87e2dd475572 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:07 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4303755b-2e83-4b2e-b128-87e2dd475572 1073741824 Aug 26 16:15:07 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:08 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc" returned: 0 in 2.240s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_iu_6x0wgdevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:15:08 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Converted 112.00 MB image at 49.98 MB/s Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:08 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc 1G Aug 26 16:15:08 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:08 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4303755b-2e83-4b2e-b128-87e2dd475572 1073741824" returned: 0 in 0.519s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4303755b-2e83-4b2e-b128-87e2dd475572 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:08 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4303755b-2e83-4b2e-b128-87e2dd475572 Aug 26 16:15:08 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:08 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc 1G" returned: 0 in 0.374s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Downloaded image 6ac3a618-4ad2-4833-9626-12a425ebacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}])) to volume 40900bca-151b-4121-9987-23890ba28ebc successfully. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Temporary image 6ac3a618-4ad2-4833-9626-12a425ebacfd for user 4e99025323564412b039786b9ee44463 is deleted. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Marking volume 40900bca-151b-4121-9987-23890ba28ebc as bootable. {{(pid=94407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Copying metadata from image 6ac3a618-4ad2-4833-9626-12a425ebacfd to 40900bca-151b-4121-9987-23890ba28ebc. {{(pid=94407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Creating volume glance metadata for volume 40900bca-151b-4121-9987-23890ba28ebc backed by image 6ac3a618-4ad2-4833-9626-12a425ebacfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642ea6ad-42a0-4a90-8843-32d19b007dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40900bca-151b-4121-9987-23890ba28ebc', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbd32ed-50cd-4b99-9b90-ea476da1861b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:08 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:08 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Volume volume-40900bca-151b-4121-9987-23890ba28ebc (40900bca-151b-4121-9987-23890ba28ebc): created successfully Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbd32ed-50cd-4b99-9b90-ea476da1861b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Flow 'volume_create_manager' (28b24828-6c3f-45ca-9ef8-5bb9dbc3ae50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4303755b-2e83-4b2e-b128-87e2dd475572" returned: 0 in 0.337s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c2251e89-0e9a-4658-b092-26e58bff6aa3 tempest-ServerActionsTestOtherA-1685579537 None] Created volume successfully. Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e456313-b9cd-4c54-89c8-932feff705f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4303755b-2e83-4b2e-b128-87e2dd475572', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efe85e1-3fad-43ea-a128-d90836617009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:08 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Volume volume-4303755b-2e83-4b2e-b128-87e2dd475572 (4303755b-2e83-4b2e-b128-87e2dd475572): created successfully Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efe85e1-3fad-43ea-a128-d90836617009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Flow 'volume_create_manager' (eb2dd3da-c781-44db-8fe0-5a7a54d4b01a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:15:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ab888e20-4b22-48b7-9073-07702dc9feae tempest-AttachVolumeTestJSON-570178932 None] Created volume successfully. Aug 26 16:15:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-6198457f-0f02-4bc4-a4b7-0c28f199b9de req-f58c916b-f02c-4ad2-a5d8-60ffc5074de2 tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-6198457f-0f02-4bc4-a4b7-0c28f199b9de req-f58c916b-f02c-4ad2-a5d8-60ffc5074de2 tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-6198457f-0f02-4bc4-a4b7-0c28f199b9de req-f58c916b-f02c-4ad2-a5d8-60ffc5074de2 tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-6198457f-0f02-4bc4-a4b7-0c28f199b9de req-f58c916b-f02c-4ad2-a5d8-60ffc5074de2 tempest-AttachVolumeTestJSON-570178932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-4303755b-2e83-4b2e-b128-87e2dd475572', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '949b1220-7dbd-409b-9cea-93fdf02857a2', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:15:11 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-6198457f-0f02-4bc4-a4b7-0c28f199b9de req-f58c916b-f02c-4ad2-a5d8-60ffc5074de2 tempest-AttachVolumeTestJSON-570178932 None] attachment_update completed successfully. Aug 26 16:15:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-97555eb7-b6d5-4be1-af31-c051efe9ede8 req-f2b8bec5-8396-4d7f-98f6-058be63f3a00 tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-97555eb7-b6d5-4be1-af31-c051efe9ede8 req-f2b8bec5-8396-4d7f-98f6-058be63f3a00 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-97555eb7-b6d5-4be1-af31-c051efe9ede8 req-f2b8bec5-8396-4d7f-98f6-058be63f3a00 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-97555eb7-b6d5-4be1-af31-c051efe9ede8 req-f2b8bec5-8396-4d7f-98f6-058be63f3a00 tempest-ServerActionsTestOtherA-1685579537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-40900bca-151b-4121-9987-23890ba28ebc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a958401d-608e-4dc8-b86c-a29dc5d6dc63', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:15:12 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-97555eb7-b6d5-4be1-af31-c051efe9ede8 req-f2b8bec5-8396-4d7f-98f6-058be63f3a00 tempest-ServerActionsTestOtherA-1685579537 None] attachment_update completed successfully. Aug 26 16:15:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:15:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:15:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:15:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:18 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:15:18 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:18 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.460s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:15:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:15:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 28 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:15:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:15:22 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=40,cinder:UPDATE=39,cinder:INSERT=12,cinder:DELETE=3 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:15:22 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=36,cinder:SELECT=54,cinder:DELETE=3,cinder:INSERT=13 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:15:34 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:15:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Flow 'volume_create_manager' (9c7279b6-f9de-4e25-8430-d93d15b3cbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792ceded-1ed4-44df-b3ff-86051f245c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792ceded-1ed4-44df-b3ff-86051f245c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1550224003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21562a9d-6e66-434f-b799-1a47a670c5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e683b143709d4571aa2fafe738bf4266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:15:35Z,use_quota=True,user_id='bc6b98b2b04c4bc6b61a863186d202c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa071af6-ff04-4f68-a2d4-ec6f2156cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa071af6-ff04-4f68-a2d4-ec6f2156cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b065f6fe-0d97-4e49-b871-d7ff080c224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b065f6fe-0d97-4e49-b871-d7ff080c224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21562a9d-6e66-434f-b799-1a47a670c5a8', 'volume_name': 'volume-21562a9d-6e66-434f-b799-1a47a670c5a8', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51897a9f-d057-411f-8d34-1d672fddd5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51897a9f-d057-411f-8d34-1d672fddd5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a595d615-eae5-4ad6-9630-ad2391b2c94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:35 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Volume 21562a9d-6e66-434f-b799-1a47a670c5a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21562a9d-6e66-434f-b799-1a47a670c5a8', 'volume_size': 1} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1550224003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21562a9d-6e66-434f-b799-1a47a670c5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e683b143709d4571aa2fafe738bf4266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:15:35Z,use_quota=True,user_id='bc6b98b2b04c4bc6b61a863186d202c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Creating volume 21562a9d-6e66-434f-b799-1a47a670c5a8 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:15:35 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:15:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-21562a9d-6e66-434f-b799-1a47a670c5a8 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:35 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-21562a9d-6e66-434f-b799-1a47a670c5a8 1073741824 Aug 26 16:15:35 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:36 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-21562a9d-6e66-434f-b799-1a47a670c5a8 1073741824" returned: 0 in 0.927s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-21562a9d-6e66-434f-b799-1a47a670c5a8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:36 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-21562a9d-6e66-434f-b799-1a47a670c5a8 Aug 26 16:15:36 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:36 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-21562a9d-6e66-434f-b799-1a47a670c5a8" returned: 0 in 0.535s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:15:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a595d615-eae5-4ad6-9630-ad2391b2c94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21562a9d-6e66-434f-b799-1a47a670c5a8', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f82c5b2-185c-436e-a1e5-471b533b535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:36 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Volume volume-21562a9d-6e66-434f-b799-1a47a670c5a8 (21562a9d-6e66-434f-b799-1a47a670c5a8): created successfully Aug 26 16:15:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f82c5b2-185c-436e-a1e5-471b533b535b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Flow 'volume_create_manager' (9c7279b6-f9de-4e25-8430-d93d15b3cbca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:15:36 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-20bc8e1d-5f1f-4791-a197-fd7bbd2cf025 tempest-VolumesListAdminTestJSON-565308295 None] Created volume successfully. Aug 26 16:15:38 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:15:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Flow 'volume_create_manager' (422ea808-6d86-462a-ba4a-b1ab74daf10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:15:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a11fcd2-1dc0-4002-8539-b92b23293265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a11fcd2-1dc0-4002-8539-b92b23293265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-642281053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc1a94d-7c30-4623-841e-892f8b0c56a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e683b143709d4571aa2fafe738bf4266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:15:39Z,use_quota=True,user_id='bc6b98b2b04c4bc6b61a863186d202c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae400ef8-e3e8-4718-8280-fa46a7d43b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae400ef8-e3e8-4718-8280-fa46a7d43b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8ff86b-5b1d-4b9e-884b-fa1824681340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8ff86b-5b1d-4b9e-884b-fa1824681340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc1a94d-7c30-4623-841e-892f8b0c56a0', 'volume_name': 'volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (929efe9a-644b-4b51-8cc9-c79c98752253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (929efe9a-644b-4b51-8cc9-c79c98752253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7785dda-86cf-4bc4-a6bb-21dcb39014ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:39 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Volume 9cc1a94d-7c30-4623-841e-892f8b0c56a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0', 'volume_size': 1} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-642281053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc1a94d-7c30-4623-841e-892f8b0c56a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e683b143709d4571aa2fafe738bf4266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:15:39Z,use_quota=True,user_id='bc6b98b2b04c4bc6b61a863186d202c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Creating volume 9cc1a94d-7c30-4623-841e-892f8b0c56a0 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:15:39 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:39 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0 1073741824 Aug 26 16:15:39 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:39 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0 1073741824" returned: 0 in 0.636s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:39 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0 Aug 26 16:15:39 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:40 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0" returned: 0 in 0.380s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:15:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7785dda-86cf-4bc4-a6bb-21dcb39014ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57ad743-ac4e-4f9b-866e-82d875bd73cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:40 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Volume volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0 (9cc1a94d-7c30-4623-841e-892f8b0c56a0): created successfully Aug 26 16:15:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57ad743-ac4e-4f9b-866e-82d875bd73cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Flow 'volume_create_manager' (422ea808-6d86-462a-ba4a-b1ab74daf10a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:15:40 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-eb064f10-2cca-41c7-a5cd-a5669069dd84 tempest-VolumesListAdminTestJSON-565308295 None] Created volume successfully. Aug 26 16:15:40 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-ce7e3da1-ce42-4746-b58b-eec62e965730 req-04a664a7-7587-4781-ba67-49b29ae451a7 tempest-ServerActionsTestOtherA-1685579537 None] Terminate volume connection completed successfully. Aug 26 16:15:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-ce7e3da1-ce42-4746-b58b-eec62e965730 req-04a664a7-7587-4781-ba67-49b29ae451a7 tempest-ServerActionsTestOtherA-1685579537 None] Deleting attachment a958401d-608e-4dc8-b86c-a29dc5d6dc63. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Flow 'volume_create_manager' (2c9d2a26-9507-4ebe-a689-3b44d346d2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b2c371-ed17-4ea1-afdb-7435d547880e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b2c371-ed17-4ea1-afdb-7435d547880e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1469695329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7612696a-0db0-43e8-919c-b081b27a878d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e683b143709d4571aa2fafe738bf4266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:15:42Z,use_quota=True,user_id='bc6b98b2b04c4bc6b61a863186d202c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675d82c9-72af-4667-915c-2d6afff2fe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675d82c9-72af-4667-915c-2d6afff2fe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c9a58f-634a-4072-a681-07072e1bc3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c9a58f-634a-4072-a681-07072e1bc3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7612696a-0db0-43e8-919c-b081b27a878d', 'volume_name': 'volume-7612696a-0db0-43e8-919c-b081b27a878d', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2424ee14-c56e-456c-baff-e6949200216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2424ee14-c56e-456c-baff-e6949200216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ae36fa-f22b-4ccc-a670-c9af67658467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:41 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Volume 7612696a-0db0-43e8-919c-b081b27a878d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7612696a-0db0-43e8-919c-b081b27a878d', 'volume_size': 1} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1469695329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7612696a-0db0-43e8-919c-b081b27a878d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e683b143709d4571aa2fafe738bf4266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:15:42Z,use_quota=True,user_id='bc6b98b2b04c4bc6b61a863186d202c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Creating volume 7612696a-0db0-43e8-919c-b081b27a878d {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:15:41 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:15:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7612696a-0db0-43e8-919c-b081b27a878d 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:41 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7612696a-0db0-43e8-919c-b081b27a878d 1073741824 Aug 26 16:15:41 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:42 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7612696a-0db0-43e8-919c-b081b27a878d 1073741824" returned: 0 in 0.555s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-ce7e3da1-ce42-4746-b58b-eec62e965730 req-d00c4cf9-9de9-4b1c-ae5c-1a606cbab274 tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7612696a-0db0-43e8-919c-b081b27a878d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:42 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7612696a-0db0-43e8-919c-b081b27a878d Aug 26 16:15:42 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:42 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7612696a-0db0-43e8-919c-b081b27a878d" returned: 0 in 0.285s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:15:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-ce7e3da1-ce42-4746-b58b-eec62e965730 req-d00c4cf9-9de9-4b1c-ae5c-1a606cbab274 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.299s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-ce7e3da1-ce42-4746-b58b-eec62e965730 req-d00c4cf9-9de9-4b1c-ae5c-1a606cbab274 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ae36fa-f22b-4ccc-a670-c9af67658467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7612696a-0db0-43e8-919c-b081b27a878d', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf8ebc5-0daa-4e55-91da-c8635b6f84f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:42 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Volume volume-7612696a-0db0-43e8-919c-b081b27a878d (7612696a-0db0-43e8-919c-b081b27a878d): created successfully Aug 26 16:15:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf8ebc5-0daa-4e55-91da-c8635b6f84f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Flow 'volume_create_manager' (2c9d2a26-9507-4ebe-a689-3b44d346d2c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:15:42 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-597d1baf-dc9d-4cd8-8f30-0c4f7ee96371 tempest-VolumesListAdminTestJSON-565308295 None] Created volume successfully. Aug 26 16:15:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-ce7e3da1-ce42-4746-b58b-eec62e965730 req-d00c4cf9-9de9-4b1c-ae5c-1a606cbab274 tempest-ServerActionsTestOtherA-1685579537 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-40900bca-151b-4121-9987-23890ba28ebc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86aaab3b-f5e3-426f-a73a-8a25499c5d8f', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:15:42 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-ce7e3da1-ce42-4746-b58b-eec62e965730 req-d00c4cf9-9de9-4b1c-ae5c-1a606cbab274 tempest-ServerActionsTestOtherA-1685579537 None] attachment_update completed successfully. Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Flow 'volume_create_manager' (16601c5b-1bd1-4038-9eef-ecc9a93e1a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90cbebe-512f-4576-a489-3c5f19a226e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90cbebe-512f-4576-a489-3c5f19a226e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671b3a87-6dc0-4422-b179-e92462634cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b55db0c6d043869a7b6a64bfbdaeb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:15:45Z,use_quota=True,user_id='a9cf74f3eefa4e83a8b4e5486cbe61c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386feec2-5441-4982-a4e0-c692dfaf7589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386feec2-5441-4982-a4e0-c692dfaf7589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7546e542-3c99-43c5-a939-52253979b69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7546e542-3c99-43c5-a939-52253979b69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '671b3a87-6dc0-4422-b179-e92462634cfc', 'volume_name': 'volume-671b3a87-6dc0-4422-b179-e92462634cfc', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee3e657-c843-45c8-b083-0d02206f9dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee3e657-c843-45c8-b083-0d02206f9dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb989f73-4a4c-4150-82e2-ddad66f1cc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:44 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Volume 671b3a87-6dc0-4422-b179-e92462634cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-671b3a87-6dc0-4422-b179-e92462634cfc', 'volume_size': 1} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671b3a87-6dc0-4422-b179-e92462634cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b55db0c6d043869a7b6a64bfbdaeb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:15:45Z,use_quota=True,user_id='a9cf74f3eefa4e83a8b4e5486cbe61c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Creating volume 671b3a87-6dc0-4422-b179-e92462634cfc {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:15:44 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:15:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-671b3a87-6dc0-4422-b179-e92462634cfc 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:44 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-671b3a87-6dc0-4422-b179-e92462634cfc 1073741824 Aug 26 16:15:44 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:45 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-671b3a87-6dc0-4422-b179-e92462634cfc 1073741824" returned: 0 in 0.556s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-671b3a87-6dc0-4422-b179-e92462634cfc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:45 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-671b3a87-6dc0-4422-b179-e92462634cfc Aug 26 16:15:45 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:45 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-671b3a87-6dc0-4422-b179-e92462634cfc" returned: 0 in 0.455s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:15:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb989f73-4a4c-4150-82e2-ddad66f1cc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671b3a87-6dc0-4422-b179-e92462634cfc', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0615c6a5-7316-49bf-9179-6fb759c82dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:15:46 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Volume volume-671b3a87-6dc0-4422-b179-e92462634cfc (671b3a87-6dc0-4422-b179-e92462634cfc): created successfully Aug 26 16:15:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0615c6a5-7316-49bf-9179-6fb759c82dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:15:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Flow 'volume_create_manager' (16601c5b-1bd1-4038-9eef-ecc9a93e1a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:15:46 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-366caf10-ad62-4341-9105-02fa4a087574 tempest-VolumesListAdminTestJSON-1200301501 None] Created volume successfully. Aug 26 16:15:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Acquiring lock "cinder-671b3a87-6dc0-4422-b179-e92462634cfc-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:15:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Lock "cinder-671b3a87-6dc0-4422-b179-e92462634cfc-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:15:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Acquiring lock "cinder-quobyte-671b3a87-6dc0-4422-b179-e92462634cfc" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:15:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Lock "cinder-quobyte-671b3a87-6dc0-4422-b179-e92462634cfc" acquired by "delete_volume" :: waited 0.049s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:15:47 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a53dcb-02c9-44f1-af87-55bfed7422ad]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:15:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-671b3a87-6dc0-4422-b179-e92462634cfc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "cinder-7612696a-0db0-43e8-919c-b081b27a878d-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:15:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Lock "cinder-7612696a-0db0-43e8-919c-b081b27a878d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:15:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "cinder-quobyte-7612696a-0db0-43e8-919c-b081b27a878d" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:15:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Lock "cinder-quobyte-7612696a-0db0-43e8-919c-b081b27a878d" acquired by "delete_volume" :: waited 0.033s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:15:48 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-671b3a87-6dc0-4422-b179-e92462634cfc Aug 26 16:15:48 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:48 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f28bf2-b1de-4eab-937c-01df2af90956]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:15:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7612696a-0db0-43e8-919c-b081b27a878d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:48 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7612696a-0db0-43e8-919c-b081b27a878d Aug 26 16:15:48 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:49 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-671b3a87-6dc0-4422-b179-e92462634cfc" returned: 0 in 1.450s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-671b3a87-6dc0-4422-b179-e92462634cfc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:49 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-671b3a87-6dc0-4422-b179-e92462634cfc Aug 26 16:15:49 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:49 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7612696a-0db0-43e8-919c-b081b27a878d" returned: 0 in 1.182s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7612696a-0db0-43e8-919c-b081b27a878d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:49 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7612696a-0db0-43e8-919c-b081b27a878d Aug 26 16:15:49 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:49 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-671b3a87-6dc0-4422-b179-e92462634cfc" returned: 0 in 0.596s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Lock "cinder-quobyte-671b3a87-6dc0-4422-b179-e92462634cfc" released by "delete_volume" :: held 2.185s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:15:50 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7612696a-0db0-43e8-919c-b081b27a878d" returned: 0 in 0.545s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Created reservations ['4c1440c3-92ff-4d8b-b23c-f460a8961bfc', 'db513698-ad46-4ba7-8031-3c7b64923030', '7ff59ee4-e9c9-4c40-861e-47cad8a48fe2', '4e502c89-7ec5-46d4-a9c6-04143cf06d94'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Lock "cinder-quobyte-7612696a-0db0-43e8-919c-b081b27a878d" released by "delete_volume" :: held 1.873s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:50 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-71404b75-aa13-4baf-8ad8-8f4890e0e149 req-0246d831-9923-42d6-948a-fc4938bf7c94 tempest-AttachVolumeTestJSON-570178932 None] Terminate volume connection completed successfully. Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-71404b75-aa13-4baf-8ad8-8f4890e0e149 req-0246d831-9923-42d6-948a-fc4938bf7c94 tempest-AttachVolumeTestJSON-570178932 None] Deleting attachment 949b1220-7dbd-409b-9cea-93fdf02857a2. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:15:50 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:15:50 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Created reservations ['10199b92-3a51-4183-927d-31045dc78218', '1d59ab0c-c624-43b5-9fd4-e76b559f8a11', 'c03b1c00-a1d5-4a36-a517-ad3aa29fb1ff', '270a96c0-52fb-44fe-8615-2a1f9f00e531'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:50 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:15:50 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:51 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.727s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:51 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:15:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Deleted volume successfully. Aug 26 16:15:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b410f9ed-da0a-492d-a6cc-9994d3db61e8 tempest-VolumesListAdminTestJSON-1200301501 None] Lock "cinder-671b3a87-6dc0-4422-b179-e92462634cfc-delete_volume" released by "delete_volume" :: held 3.845s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:15:51 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.761s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:51 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:15:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Deleted volume successfully. Aug 26 16:15:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3e6bc97a-d657-418e-ab46-ccafe10b5759 tempest-VolumesListAdminTestJSON-565308295 None] Lock "cinder-7612696a-0db0-43e8-919c-b081b27a878d-delete_volume" released by "delete_volume" :: held 3.483s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:15:52 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "cinder-9cc1a94d-7c30-4623-841e-892f8b0c56a0-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:15:52 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Lock "cinder-9cc1a94d-7c30-4623-841e-892f8b0c56a0-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:15:52 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "cinder-quobyte-9cc1a94d-7c30-4623-841e-892f8b0c56a0" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:15:52 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Lock "cinder-quobyte-9cc1a94d-7c30-4623-841e-892f8b0c56a0" acquired by "delete_volume" :: waited 0.066s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:15:52 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f32308-bb42-41ab-93e5-b44e9daeb8ad]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:15:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:53 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0 Aug 26 16:15:53 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:53 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0" returned: 0 in 1.101s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:53 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0 Aug 26 16:15:53 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:54 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9cc1a94d-7c30-4623-841e-892f8b0c56a0" returned: 0 in 0.353s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Lock "cinder-quobyte-9cc1a94d-7c30-4623-841e-892f8b0c56a0" released by "delete_volume" :: held 1.581s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:15:54 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Created reservations ['2f477b8b-4b18-4381-9b3c-c0611e14169b', '4708538a-c8d1-49c5-a849-beb0437f7b4a', '40341396-cd4b-4703-b514-ca4afe6e6bf7', 'f37c0e6c-6c99-4076-aaa5-58727baa94eb'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:15:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:15:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:15:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:54 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:15:54 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "cinder-21562a9d-6e66-434f-b799-1a47a670c5a8-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:15:54 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.709s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:55 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:15:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Deleted volume successfully. Aug 26 16:15:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Lock "cinder-21562a9d-6e66-434f-b799-1a47a670c5a8-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:15:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-48e1b843-ad20-4276-bfb8-4c764d1de3ef tempest-VolumesListAdminTestJSON-565308295 None] Lock "cinder-9cc1a94d-7c30-4623-841e-892f8b0c56a0-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:15:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "cinder-quobyte-21562a9d-6e66-434f-b799-1a47a670c5a8" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:15:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Lock "cinder-quobyte-21562a9d-6e66-434f-b799-1a47a670c5a8" acquired by "delete_volume" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:15:55 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4802c9-6e55-4ad7-8bd0-23e739f97ab8]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:15:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-21562a9d-6e66-434f-b799-1a47a670c5a8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:55 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-21562a9d-6e66-434f-b799-1a47a670c5a8 Aug 26 16:15:55 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:56 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-21562a9d-6e66-434f-b799-1a47a670c5a8" returned: 0 in 1.093s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-21562a9d-6e66-434f-b799-1a47a670c5a8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:56 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-21562a9d-6e66-434f-b799-1a47a670c5a8 Aug 26 16:15:56 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:56 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-21562a9d-6e66-434f-b799-1a47a670c5a8" returned: 0 in 0.326s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Lock "cinder-quobyte-21562a9d-6e66-434f-b799-1a47a670c5a8" released by "delete_volume" :: held 1.577s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:15:56 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Created reservations ['532d4b0f-de2d-4e0b-94a4-6d37e1bbcfac', '4fec385a-ac77-46c4-b5dd-9d826d1b5e48', '93dbc65c-124b-46d1-a896-4cd5b162c23c', 'a47fac19-b8b1-4b4a-b8d9-3e4a353c847d'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:15:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:15:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:15:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:15:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:15:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:15:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:15:57 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:15:57 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:15:57 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Aug 26 16:15:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.760s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:15:57 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:15:57 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Deleted volume successfully. Aug 26 16:15:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3920ad46-bcae-4829-b70e-a28f0d5c308e tempest-VolumesListAdminTestJSON-565308295 None] Lock "cinder-21562a9d-6e66-434f-b799-1a47a670c5a8-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:07 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=38,cinder:UPDATE=38,cinder:DELETE=4,cinder:INSERT=12 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:16:07 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=35,cinder:UPDATE=53,cinder:INSERT=8,cinder:DELETE=4 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Flow 'volume_create_manager' (246afa82-b7cc-403f-8940-a7ad293d6299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdebc78-54c0-45c7-9b54-337757c11ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdebc78-54c0-45c7-9b54-337757c11ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2042268660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76813bbb-27f7-4316-b789-bc2786b78cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d22ac0640a49599b4805ab6f3d292c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:16:11Z,use_quota=True,user_id='b6fd6727915a48258f3c49bd6d88b8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56af4c3f-77ca-49c7-a9e5-701263173241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56af4c3f-77ca-49c7-a9e5-701263173241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d569044-5b3d-4e4d-b9c3-9cc6577ea271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d569044-5b3d-4e4d-b9c3-9cc6577ea271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76813bbb-27f7-4316-b789-bc2786b78cd7', 'volume_name': 'volume-76813bbb-27f7-4316-b789-bc2786b78cd7', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7233638b-d8d7-463f-bb99-39fc25627130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7233638b-d8d7-463f-bb99-39fc25627130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb83dd0-7edd-4c3d-b463-7da0282a9aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:11 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Volume 76813bbb-27f7-4316-b789-bc2786b78cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76813bbb-27f7-4316-b789-bc2786b78cd7', 'volume_size': 1} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2042268660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76813bbb-27f7-4316-b789-bc2786b78cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d22ac0640a49599b4805ab6f3d292c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:16:11Z,use_quota=True,user_id='b6fd6727915a48258f3c49bd6d88b8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Creating volume 76813bbb-27f7-4316-b789-bc2786b78cd7 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:16:11 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:16:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-76813bbb-27f7-4316-b789-bc2786b78cd7 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:11 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-76813bbb-27f7-4316-b789-bc2786b78cd7 1073741824 Aug 26 16:16:11 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:12 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-76813bbb-27f7-4316-b789-bc2786b78cd7 1073741824" returned: 0 in 0.412s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-76813bbb-27f7-4316-b789-bc2786b78cd7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:12 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-76813bbb-27f7-4316-b789-bc2786b78cd7 Aug 26 16:16:12 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:12 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-76813bbb-27f7-4316-b789-bc2786b78cd7" returned: 0 in 0.235s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb83dd0-7edd-4c3d-b463-7da0282a9aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76813bbb-27f7-4316-b789-bc2786b78cd7', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6c59c8-a63d-41f7-852b-201e6605dcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:12 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Volume volume-76813bbb-27f7-4316-b789-bc2786b78cd7 (76813bbb-27f7-4316-b789-bc2786b78cd7): created successfully Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6c59c8-a63d-41f7-852b-201e6605dcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Flow 'volume_create_manager' (246afa82-b7cc-403f-8940-a7ad293d6299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:16:12 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f16f60e6-e8a2-4cf6-91fb-bea1fbce9a91 tempest-AbsoluteLimitsTests-1968086128 None] Created volume successfully. Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Acquiring lock "cinder-76813bbb-27f7-4316-b789-bc2786b78cd7-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Lock "cinder-76813bbb-27f7-4316-b789-bc2786b78cd7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Acquiring lock "cinder-quobyte-76813bbb-27f7-4316-b789-bc2786b78cd7" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Lock "cinder-quobyte-76813bbb-27f7-4316-b789-bc2786b78cd7" acquired by "delete_volume" :: waited 0.016s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb6259-50c2-4d11-84c7-f90e3b6b5a3d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:16:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-76813bbb-27f7-4316-b789-bc2786b78cd7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:12 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-76813bbb-27f7-4316-b789-bc2786b78cd7 Aug 26 16:16:12 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:13 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-76813bbb-27f7-4316-b789-bc2786b78cd7" returned: 0 in 0.367s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-76813bbb-27f7-4316-b789-bc2786b78cd7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:13 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-76813bbb-27f7-4316-b789-bc2786b78cd7 Aug 26 16:16:13 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:13 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-76813bbb-27f7-4316-b789-bc2786b78cd7" returned: 0 in 0.253s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Lock "cinder-quobyte-76813bbb-27f7-4316-b789-bc2786b78cd7" released by "delete_volume" :: held 0.666s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Created reservations ['c1af1ac0-5d6b-4c42-97c8-2095635d6d5b', 'accce3dd-92fb-4088-8810-857437ec91b5', '96bd271c-7324-4e70-96b4-c3eada1f6b80', '27e4e6e0-cce2-4247-b1a5-700c28bd6e28'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:13 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:16:13 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:13 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.310s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:16:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Deleted volume successfully. Aug 26 16:16:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e747df03-7839-4d6f-b7b1-e5e599201024 tempest-AbsoluteLimitsTests-1968086128 None] Lock "cinder-76813bbb-27f7-4316-b789-bc2786b78cd7-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:16:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:16:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:16:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:17 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:16:17 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:18 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.313s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 28 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Flow 'volume_create_manager' (19dc0db3-8bde-42a4-8014-25509ce37aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab5d4bf-6d45-4280-a1cf-0fbdee1c4e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab5d4bf-6d45-4280-a1cf-0fbdee1c4e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-650138970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3022afa3-b6e5-4bad-8319-f18fb11cd679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aed0d84c09a4cbfb08c000488c5614b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:16:19Z,use_quota=True,user_id='448e8e52255a40c0b0d9bfd3c92f5820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3787ff-cc3b-42d0-bf99-83ff5e2f0965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3787ff-cc3b-42d0-bf99-83ff5e2f0965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9abadb-d308-472a-b337-2f6c93d4679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9abadb-d308-472a-b337-2f6c93d4679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3022afa3-b6e5-4bad-8319-f18fb11cd679', 'volume_name': 'volume-3022afa3-b6e5-4bad-8319-f18fb11cd679', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d45137-cb92-4fd9-904f-210fdb7d7c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d45137-cb92-4fd9-904f-210fdb7d7c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24578ba3-3674-453a-809e-27416793c54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:18 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Volume 3022afa3-b6e5-4bad-8319-f18fb11cd679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3022afa3-b6e5-4bad-8319-f18fb11cd679', 'volume_size': 1} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-650138970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3022afa3-b6e5-4bad-8319-f18fb11cd679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aed0d84c09a4cbfb08c000488c5614b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:16:19Z,use_quota=True,user_id='448e8e52255a40c0b0d9bfd3c92f5820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Creating volume 3022afa3-b6e5-4bad-8319-f18fb11cd679 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:16:18 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:16:18 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 1073741824 Aug 26 16:16:18 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Flow 'volume_create_manager' (5e6d2ad7-a5c4-46ea-87ca-dd4313bfc7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d77fa44-445a-480c-8cfc-d71ad5c94a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d77fa44-445a-480c-8cfc-d71ad5c94a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-891357939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ad37ea-fc0a-4935-a70b-8714fd50d95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bfcc12896e4aa4ac89644635572619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:16:19Z,use_quota=True,user_id='14b14cc0e709467f8966b109d01b7168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2732a2a-e488-479c-9dd3-f1e037332a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2732a2a-e488-479c-9dd3-f1e037332a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82684b2f-8729-427b-a431-3540729ec3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82684b2f-8729-427b-a431-3540729ec3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ad37ea-fc0a-4935-a70b-8714fd50d95e', 'volume_name': 'volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5f00c2-550a-495c-8270-86b48d7d474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5f00c2-550a-495c-8270-86b48d7d474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21eadf7-4f53-4d1f-a107-5ab28a4f7dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:18 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Volume 22ad37ea-fc0a-4935-a70b-8714fd50d95e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e', 'volume_size': 1} Aug 26 16:16:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:19 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 1073741824" returned: 0 in 0.473s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:19 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 Aug 26 16:16:19 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:19 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679" returned: 0 in 0.396s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-891357939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ad37ea-fc0a-4935-a70b-8714fd50d95e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bfcc12896e4aa4ac89644635572619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:16:19Z,use_quota=True,user_id='14b14cc0e709467f8966b109d01b7168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Creating volume 22ad37ea-fc0a-4935-a70b-8714fd50d95e {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:16:19 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:19 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e 1073741824 Aug 26 16:16:19 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24578ba3-3674-453a-809e-27416793c54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3022afa3-b6e5-4bad-8319-f18fb11cd679', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08028e70-0aca-4229-b8a5-cd7383afbaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:19 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Volume volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 (3022afa3-b6e5-4bad-8319-f18fb11cd679): created successfully Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08028e70-0aca-4229-b8a5-cd7383afbaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:19 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Flow 'volume_create_manager' (19dc0db3-8bde-42a4-8014-25509ce37aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:16:19 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5b4f8141-be16-462d-8ae7-7368a89adc59 tempest-VolumesCloneTest-1417196948 None] Created volume successfully. Aug 26 16:16:20 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e 1073741824" returned: 0 in 0.494s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:20 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e Aug 26 16:16:20 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:20 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e" returned: 0 in 0.283s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:20 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:16:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21eadf7-4f53-4d1f-a107-5ab28a4f7dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd541e43-0398-44ca-8269-9a59f2f00d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:20 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Volume volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e (22ad37ea-fc0a-4935-a70b-8714fd50d95e): created successfully Aug 26 16:16:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd541e43-0398-44ca-8269-9a59f2f00d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Flow 'volume_create_manager' (5e6d2ad7-a5c4-46ea-87ca-dd4313bfc7e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:16:20 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bcb3e406-2ac4-46ed-b506-4053003a9c93 tempest-AttachVolumeNegativeTest-1059842712 None] Created volume successfully. Aug 26 16:16:20 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-f0a904ab-0851-49aa-81d8-af30e6b073bf tempest-ServerActionsTestOtherA-1685579537 None] Terminate volume connection completed successfully. Aug 26 16:16:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-f0a904ab-0851-49aa-81d8-af30e6b073bf tempest-ServerActionsTestOtherA-1685579537 None] Deleting attachment 86aaab3b-f5e3-426f-a73a-8a25499c5d8f. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "cinder-40900bca-151b-4121-9987-23890ba28ebc-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Flow 'volume_create_manager' (20be2d8f-7a5a-4a7e-bafb-8b95d2c07a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4400a39-0203-4b0c-a076-8e31abb56b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Lock "cinder-40900bca-151b-4121-9987-23890ba28ebc-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4400a39-0203-4b0c-a076-8e31abb56b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2133876914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda2c3fe-c2eb-47d3-b7bf-f54916d425ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aed0d84c09a4cbfb08c000488c5614b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:16:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3022afa3-b6e5-4bad-8319-f18fb11cd679,status='creating',terminated_at=None,updated_at=2026-08-26T14:16:21Z,use_quota=True,user_id='448e8e52255a40c0b0d9bfd3c92f5820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4196456-ec4a-4195-b5af-0696e09f4ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4196456-ec4a-4195-b5af-0696e09f4ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c60442-9688-4ff3-941a-d681d67856cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c60442-9688-4ff3-941a-d681d67856cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cda2c3fe-c2eb-47d3-b7bf-f54916d425ae', 'volume_name': 'volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae', 'volume_size': 2, 'source_volid': '3022afa3-b6e5-4bad-8319-f18fb11cd679', 'source_volstatus': 'available'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417166f3-8ad7-4c02-9136-8e7fd4e57937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417166f3-8ad7-4c02-9136-8e7fd4e57937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a789f002-d695-4f2f-a73f-b154fdf374ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:21 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Volume cda2c3fe-c2eb-47d3-b7bf-f54916d425ae: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae', 'volume_size': 2, 'source_volid': '3022afa3-b6e5-4bad-8319-f18fb11cd679', 'source_volstatus': 'available'} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:21 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Cloning volume 3022afa3-b6e5-4bad-8319-f18fb11cd679 to volume cda2c3fe-c2eb-47d3-b7bf-f54916d425ae Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "cinder-quobyte-40900bca-151b-4121-9987-23890ba28ebc" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Lock "cinder-quobyte-40900bca-151b-4121-9987-23890ba28ebc" acquired by "delete_volume" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Creating offline snapshot 3ed197f3-951f-4936-97c8-90b763303491 of volume 3022afa3-b6e5-4bad-8319-f18fb11cd679 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c8fb0c-f361-438c-9297-143fe5bd1056]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2056f284-5406-46c0-8a09-2560ae721a76]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:21 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc Aug 26 16:16:21 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:21 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 Aug 26 16:16:21 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:21 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc" returned: 0 in 0.404s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:21 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679" returned: 0 in 0.415s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:21 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc Aug 26 16:16:21 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:21 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 1G Aug 26 16:16:21 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:22 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-40900bca-151b-4121-9987-23890ba28ebc" returned: 0 in 0.285s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Lock "cinder-quobyte-40900bca-151b-4121-9987-23890ba28ebc" released by "delete_volume" :: held 0.743s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG cinder.quota [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Created reservations ['97d78a75-35d1-4f96-884d-b59fc7eda4d7', '9bc56425-4463-4aa1-ae4c-2405e4c7ab2c', 'af294cd4-618f-4a67-b837-1df32a49d77f', '0af63c2d-dfe9-4e20-95ed-25483b4f4800'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:22 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:16:22 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:22 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 1G" returned: 0 in 0.481s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:22 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 Aug 26 16:16:22 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:22 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.308s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG cinder.manager [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:16:22 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Deleted volume successfully. Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-3a2b7657-baa0-468b-ad0c-77858795f091 req-ed841780-9f14-4b08-8d9d-0fb99bdcd305 tempest-ServerActionsTestOtherA-1685579537 None] Lock "cinder-40900bca-151b-4121-9987-23890ba28ebc-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:22 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491" returned: 0 in 0.386s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:22 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 is being set with open permissions: ugo+rw Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-ea421225-8672-4436-b299-7d020d07537b req-b7fcdd6b-d8d8-4e5d-9ab5-6d2c79fa0dbb tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:22 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 Aug 26 16:16:22 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "cinder-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Lock "cinder-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "cinder-quobyte-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:22 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Lock "cinder-quobyte-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491" returned: 0 in 0.317s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcac584-2693-4fb1-a5b8-99fc35de1f1f]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:23 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.info Aug 26 16:16:23 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:23 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1 Aug 26 16:16:23 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:23 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.info" returned: 0 in 0.278s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:23 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.info is being set with open permissions: ugo+rw Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:23 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.info Aug 26 16:16:23 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:23 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1" returned: 0 in 0.422s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:23 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1 Aug 26 16:16:23 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:23 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.info" returned: 0 in 0.317s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Acquiring lock "cinder-quobyte-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae" by "_copy_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Lock "cinder-quobyte-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] snapshot: 3ed197f3-951f-4936-97c8-90b763303491, volume: cda2c3fe-c2eb-47d3-b7bf-f54916d425ae, {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:16:23 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1" returned: 0 in 0.301s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2441218a-7df7-4d61-b35e-e34b129b1184]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Lock "cinder-quobyte-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1" released by "delete_volume" :: held 0.793s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Created reservations ['c6966aec-13f7-4a87-bd2b-43df99165f61', 'aa054d59-9707-462f-8da8-16eb546a7d05', '86ee1073-4062-46fa-b491-075003a6dc1e', '289feceb-c37c-47aa-b715-facaaed1edc3'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:16:23 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 Aug 26 16:16:23 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:23 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:16:23 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:24 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491" returned: 0 in 0.391s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3022afa3-b6e5-4bad-8319-f18fb11cd679(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:16:24 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a99638-3a07-48ed-8842-b8ab87af7cc9]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:16:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:24 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.289s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:24 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:16:24 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Deleted volume successfully. Aug 26 16:16:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-afaf5e1c-9692-4adf-924f-5b0d5016bb74 tempest-ServerActionsTestOtherA-1685579537 None] Lock "cinder-9c0e2cf5-c0d6-4081-b819-29c5e265ceb1-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:24 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 Aug 26 16:16:24 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:24 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679" returned: 0 in 0.422s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] will copy from snapshot at /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 16:16:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Creating direct copy from snapshot {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 16:16:24 devstack cinder-volume[94407]: DEBUG cinder.utils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Path /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae not found in is_blk_device check {{(pid=94407) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 16:16:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:24 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae Aug 26 16:16:24 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:31 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae" returned: 0 in 6.652s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:16:31 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Converted 1024.00 MB image at 153.90 MB/s Aug 26 16:16:31 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae is being set with open permissions: ugo+rw Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:31 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae Aug 26 16:16:31 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:31 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae" returned: 0 in 0.276s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Lock "cinder-quobyte-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae" released by "_copy_volume_from_snapshot" :: held 7.834s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Acquiring lock "cinder-quobyte-3ed197f3-951f-4936-97c8-90b763303491" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Lock "cinder-quobyte-3ed197f3-951f-4936-97c8-90b763303491" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Deleting offline snapshot 3ed197f3-951f-4936-97c8-90b763303491 of volume 3022afa3-b6e5-4bad-8319-f18fb11cd679 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] snapshot_file for this snap is: volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a0666d-b2c0-423b-9295-c091addb42ec]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:31 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 Aug 26 16:16:31 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:31 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491" returned: 0 in 0.379s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3022afa3-b6e5-4bad-8319-f18fb11cd679(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b8b102-5836-44bb-b930-43a8fd764377]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:16:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:32 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 Aug 26 16:16:32 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:32 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679" returned: 0 in 0.633s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:32 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 Aug 26 16:16:32 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:32 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491" returned: 0 in 0.356s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:32 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491 Aug 26 16:16:32 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:33 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679.3ed197f3-951f-4936-97c8-90b763303491" returned: 0 in 0.289s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:33 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Lock "cinder-quobyte-3ed197f3-951f-4936-97c8-90b763303491" released by "_delete_snapshot" :: held 1.772s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.090s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-ea421225-8672-4436-b299-7d020d07537b req-b7fcdd6b-d8d8-4e5d-9ab5-6d2c79fa0dbb tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.699s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a789f002-d695-4f2f-a73f-b154fdf374ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae', 'volume_size': 2, 'source_volid': '3022afa3-b6e5-4bad-8319-f18fb11cd679', 'source_volstatus': 'available'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c18187-1686-4de2-9ab2-b7ac01a4747b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-ea421225-8672-4436-b299-7d020d07537b req-b7fcdd6b-d8d8-4e5d-9ab5-6d2c79fa0dbb tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.064s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:33 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Volume volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae (cda2c3fe-c2eb-47d3-b7bf-f54916d425ae): created successfully Aug 26 16:16:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c18187-1686-4de2-9ab2-b7ac01a4747b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Flow 'volume_create_manager' (20be2d8f-7a5a-4a7e-bafb-8b95d2c07a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:16:33 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-d431b32c-5861-4de4-99a2-b6ecf6958b2c tempest-VolumesCloneTest-1417196948 None] Created volume successfully. Aug 26 16:16:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-ea421225-8672-4436-b299-7d020d07537b req-b7fcdd6b-d8d8-4e5d-9ab5-6d2c79fa0dbb tempest-AttachVolumeNegativeTest-1059842712 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0843050-26a4-45c9-9dc9-535941b119b9', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:16:33 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-ea421225-8672-4436-b299-7d020d07537b req-b7fcdd6b-d8d8-4e5d-9ab5-6d2c79fa0dbb tempest-AttachVolumeNegativeTest-1059842712 None] attachment_update completed successfully. Aug 26 16:16:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Acquiring lock "cinder-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Lock "cinder-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Acquiring lock "cinder-quobyte-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Lock "cinder-quobyte-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:34 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccaebfa-c3ec-4c4b-98a8-4aba79a060f8]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:16:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:35 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae Aug 26 16:16:35 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:35 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae" returned: 0 in 0.458s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:35 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae Aug 26 16:16:35 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:35 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae" returned: 0 in 0.322s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:35 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Lock "cinder-quobyte-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae" released by "delete_volume" :: held 0.834s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:35 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Created reservations ['fbfc64eb-bc61-4b4b-a192-77b5ed2061fb', 'a901f06c-bae4-4b9c-934a-c5c2734426e1', '2d1aff91-a636-4b8b-9caf-41b7dd8a66cf', '76e36a41-3dd1-477e-9917-4a78c3ba279a'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:16:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:16:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:16:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:35 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:16:35 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Acquiring lock "cinder-3022afa3-b6e5-4bad-8319-f18fb11cd679-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Lock "cinder-3022afa3-b6e5-4bad-8319-f18fb11cd679-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Acquiring lock "cinder-quobyte-3022afa3-b6e5-4bad-8319-f18fb11cd679" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Lock "cinder-quobyte-3022afa3-b6e5-4bad-8319-f18fb11cd679" acquired by "delete_volume" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:36 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.361s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:36 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:16:36 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Deleted volume successfully. Aug 26 16:16:36 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0d5c7c-7256-44e0-8e3d-8f7eb78228f2]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:16:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3fe632c6-2a38-4475-828f-ee1da1dd4cfc tempest-VolumesCloneTest-1417196948 None] Lock "cinder-cda2c3fe-c2eb-47d3-b7bf-f54916d425ae-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:36 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 Aug 26 16:16:36 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:36 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679" returned: 0 in 0.413s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:36 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679 Aug 26 16:16:36 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:36 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3022afa3-b6e5-4bad-8319-f18fb11cd679" returned: 0 in 0.288s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:37 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Lock "cinder-quobyte-3022afa3-b6e5-4bad-8319-f18fb11cd679" released by "delete_volume" :: held 0.796s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:37 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Created reservations ['864b6909-f130-43e2-b30f-5c4ef5c74aad', '3b4c11ee-e4bd-4799-9d30-e24478486a65', '31d5a1dc-d1df-4cf1-a3f0-e63ea13f0b8a', '4f33e3f4-512e-45fa-8462-a897454cef43'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:16:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:16:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:16:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:37 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:16:37 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:37 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.321s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:37 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:16:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Deleted volume successfully. Aug 26 16:16:37 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6f138bd9-0214-4d2d-b95e-35909309be75 tempest-VolumesCloneTest-1417196948 None] Lock "cinder-3022afa3-b6e5-4bad-8319-f18fb11cd679-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Flow 'volume_create_manager' (90832f13-6e27-4005-b652-67a66a808071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c185885a-5b23-44c6-b718-075ca7700714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c185885a-5b23-44c6-b718-075ca7700714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-909891556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94dcd7b-8a4b-40d6-aaab-916010c0fdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f0bac98f3c4b2983ad238e4498ec7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:16:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:16:42Z,use_quota=True,user_id='abe0e2a917ba44fea336dea3e88b01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c280e4-7845-4e0d-9430-7d3c32794414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c280e4-7845-4e0d-9430-7d3c32794414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d66bf89-6a3e-4e74-8fe6-246da81a2406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d66bf89-6a3e-4e74-8fe6-246da81a2406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f94dcd7b-8a4b-40d6-aaab-916010c0fdb0', 'volume_name': 'volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0', 'volume_size': 2}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d63e1da-74d3-4a99-b1ad-fdaa47bc5452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d63e1da-74d3-4a99-b1ad-fdaa47bc5452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f333f47-552c-48f5-b75b-a01a2d421d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:42 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Volume f94dcd7b-8a4b-40d6-aaab-916010c0fdb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0', 'volume_size': 2} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-909891556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94dcd7b-8a4b-40d6-aaab-916010c0fdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f0bac98f3c4b2983ad238e4498ec7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:16:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:16:42Z,use_quota=True,user_id='abe0e2a917ba44fea336dea3e88b01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Creating volume f94dcd7b-8a4b-40d6-aaab-916010c0fdb0 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:16:42 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0 2147483648 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:42 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0 2147483648 Aug 26 16:16:42 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:42 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0 2147483648" returned: 0 in 0.604s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:42 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0 Aug 26 16:16:42 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:43 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0" returned: 0 in 0.301s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:43 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:16:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:43 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f333f47-552c-48f5-b75b-a01a2d421d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0', 'volume_size': 2}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:43 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4fca2e-7553-492b-ac4f-856921888372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:16:43 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Volume volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0 (f94dcd7b-8a4b-40d6-aaab-916010c0fdb0): created successfully Aug 26 16:16:43 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c4fca2e-7553-492b-ac4f-856921888372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:16:43 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Flow 'volume_create_manager' (90832f13-6e27-4005-b652-67a66a808071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:16:43 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ce60df78-7fa1-49a3-a075-073d8cb9d5ea tempest-VolumesCloneNegativeTest-1961974609 None] Created volume successfully. Aug 26 16:16:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Acquiring lock "cinder-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Lock "cinder-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Acquiring lock "cinder-quobyte-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:16:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Lock "cinder-quobyte-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:16:44 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[195797c2-ed7b-43be-8ef9-2ad6b8a3ec6b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:16:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:44 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0 Aug 26 16:16:44 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:44 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0" returned: 0 in 0.438s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:44 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0 Aug 26 16:16:44 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:45 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0" returned: 0 in 0.272s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Lock "cinder-quobyte-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0" released by "delete_volume" :: held 0.779s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:45 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Created reservations ['e8225d35-fc99-4264-b0fd-979a14b4b9aa', '24be58e6-e8a8-4331-bb7b-099026de3ade', '4d3131c1-0512-4b39-a2b0-cd9c3fff742d', 'b9f5681d-d989-4e9c-a44b-1beabc98aaff'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:16:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:16:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:16:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:16:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:16:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:16:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:16:45 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:16:45 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:16:45 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Aug 26 16:16:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.343s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:16:45 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:16:45 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Deleted volume successfully. Aug 26 16:16:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-32793d7d-8b13-4082-a7bb-b8c4ab515b3f tempest-VolumesCloneNegativeTest-1961974609 None] Lock "cinder-f94dcd7b-8a4b-40d6-aaab-916010c0fdb0-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:16:58 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=56,cinder:UPDATE=64,cinder:INSERT=15,cinder:DELETE=5 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:16:58 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=69,cinder:SELECT=46,cinder:INSERT=16,cinder:DELETE=6 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Flow 'volume_create_manager' (a59a589b-9c4e-4ec5-93b0-181e8cd2725a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e50d13-e5c0-4ea1-ae8d-00f186ceafd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e50d13-e5c0-4ea1-ae8d-00f186ceafd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1685664865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebe3d1f-3b16-4471-9ab5-c709b581f269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6df02054c44710b825d2d2a5e3c511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:07Z,use_quota=True,user_id='acd693be3fce4fa199b2e01b2d03b647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e47970f-554c-4103-8d77-c6805669efdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e47970f-554c-4103-8d77-c6805669efdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c12045-8b0f-480f-991a-82468724eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c12045-8b0f-480f-991a-82468724eeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebe3d1f-3b16-4471-9ab5-c709b581f269', 'volume_name': 'volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefdae24-706a-4a71-b783-4c63181b4297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefdae24-706a-4a71-b783-4c63181b4297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0780ada6-3f8e-499e-aab4-dc6c195f92fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:07 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Volume 2ebe3d1f-3b16-4471-9ab5-c709b581f269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269', 'volume_size': 1} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1685664865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebe3d1f-3b16-4471-9ab5-c709b581f269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6df02054c44710b825d2d2a5e3c511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:07Z,use_quota=True,user_id='acd693be3fce4fa199b2e01b2d03b647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Creating volume 2ebe3d1f-3b16-4471-9ab5-c709b581f269 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:17:07 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:17:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:07 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 1073741824 Aug 26 16:17:07 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:08 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 1073741824" returned: 0 in 0.666s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:08 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 Aug 26 16:17:08 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:08 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269" returned: 0 in 0.299s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:17:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0780ada6-3f8e-499e-aab4-dc6c195f92fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b42d7e9-5f2b-4524-afcd-6a3ab1e687af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:08 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Volume volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 (2ebe3d1f-3b16-4471-9ab5-c709b581f269): created successfully Aug 26 16:17:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b42d7e9-5f2b-4524-afcd-6a3ab1e687af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Flow 'volume_create_manager' (a59a589b-9c4e-4ec5-93b0-181e8cd2725a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f67dbf47-3892-4cfa-94b0-e81fd32ab732 tempest-VolumesSnapshotTestJSON-1253256666 None] Created volume successfully. Aug 26 16:17:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] Creating offline snapshot 126ae4ca-7d5d-4014-b4e6-70599aafa494 of volume 2ebe3d1f-3b16-4471-9ab5-c709b581f269 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:17:09 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fd560d-a674-4e58-87a1-e9648f61074e]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:09 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 Aug 26 16:17:09 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:10 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269" returned: 0 in 0.441s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:10 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 1G Aug 26 16:17:10 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:11 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 1G" returned: 0 in 0.747s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:11 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 Aug 26 16:17:11 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:11 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494" returned: 0 in 0.485s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:11 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 is being set with open permissions: ugo+rw Aug 26 16:17:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:11 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 Aug 26 16:17:11 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:11 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494" returned: 0 in 0.289s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:11 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.info Aug 26 16:17:11 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:12 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.info" returned: 0 in 0.257s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:12 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.info is being set with open permissions: ugo+rw Aug 26 16:17:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:12 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.info Aug 26 16:17:12 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:12 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.info" returned: 0 in 0.260s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.590s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:12 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-fa7a5d53-11d4-4a88-862a-196bb51af80b tempest-VolumesSnapshotTestJSON-1253256666 None] Create snapshot completed successfully Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-126ae4ca-7d5d-4014-b4e6-70599aafa494-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-126ae4ca-7d5d-4014-b4e6-70599aafa494-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-2ebe3d1f-3b16-4471-9ab5-c709b581f269" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-2ebe3d1f-3b16-4471-9ab5-c709b581f269" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-126ae4ca-7d5d-4014-b4e6-70599aafa494" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-126ae4ca-7d5d-4014-b4e6-70599aafa494" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Deleting offline snapshot 126ae4ca-7d5d-4014-b4e6-70599aafa494 of volume 2ebe3d1f-3b16-4471-9ab5-c709b581f269 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] snapshot_file for this snap is: volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63f73a7-6c74-4156-b676-5970e12090a9]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:13 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 Aug 26 16:17:13 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:13 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494" returned: 0 in 0.512s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[013533b1-fe50-4f0f-a127-2a08a32e767c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:14 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 Aug 26 16:17:14 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:14 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269" returned: 0 in 0.440s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:14 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 Aug 26 16:17:14 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:14 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494" returned: 0 in 0.367s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:14 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494 Aug 26 16:17:14 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:14 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269.126ae4ca-7d5d-4014-b4e6-70599aafa494" returned: 0 in 0.268s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-126ae4ca-7d5d-4014-b4e6-70599aafa494" released by "_delete_snapshot" :: held 1.726s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-2ebe3d1f-3b16-4471-9ab5-c709b581f269" released by "delete_snapshot" :: held 1.765s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:15 devstack cinder-volume[94407]: WARNING cinder.quota [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:17:15 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Created reservations ['ab60bba6-404b-41aa-969b-0721b60369b1', '9e8372f7-0aff-4c7a-8cfc-1d04c425d78c', 'e95a4db6-b247-42d0-9ac3-735ba8eca6f4', 'c11c4aca-e943-4484-a8f0-ab0200035c01'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:17:15 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Delete snapshot completed successfully. Aug 26 16:17:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-977ccfce-18d5-493c-bbf8-138d721cf381 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-126ae4ca-7d5d-4014-b4e6-70599aafa494-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Flow 'volume_create_manager' (0d7e0419-8955-4f4f-aa1b-286a5b1f2472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af28d922-6436-4964-882b-300bca6762eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af28d922-6436-4964-882b-300bca6762eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-892157289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063801ab-4057-4636-a8ae-5068ccf86443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6df02054c44710b825d2d2a5e3c511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:16Z,use_quota=True,user_id='acd693be3fce4fa199b2e01b2d03b647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764ce295-0edb-4e50-aa76-5f77a3014a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764ce295-0edb-4e50-aa76-5f77a3014a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae73b9b-9b0d-42f9-927d-d49ee7ff90bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae73b9b-9b0d-42f9-927d-d49ee7ff90bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '063801ab-4057-4636-a8ae-5068ccf86443', 'volume_name': 'volume-063801ab-4057-4636-a8ae-5068ccf86443', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb8f059-be55-4ce4-9281-cc907c8107e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb8f059-be55-4ce4-9281-cc907c8107e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f71d51-2244-4f0e-b112-b173a7a39fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:16 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Volume 063801ab-4057-4636-a8ae-5068ccf86443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-063801ab-4057-4636-a8ae-5068ccf86443', 'volume_size': 1} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-892157289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063801ab-4057-4636-a8ae-5068ccf86443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6df02054c44710b825d2d2a5e3c511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:16Z,use_quota=True,user_id='acd693be3fce4fa199b2e01b2d03b647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Creating volume 063801ab-4057-4636-a8ae-5068ccf86443 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:17:16 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:16 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 1073741824 Aug 26 16:17:16 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:16 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 1073741824" returned: 0 in 0.455s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:16 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 Aug 26 16:17:16 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:16 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443" returned: 0 in 0.261s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f71d51-2244-4f0e-b112-b173a7a39fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063801ab-4057-4636-a8ae-5068ccf86443', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e3e0a8-603d-4efe-aa32-e1951c7cb780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:16 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Volume volume-063801ab-4057-4636-a8ae-5068ccf86443 (063801ab-4057-4636-a8ae-5068ccf86443): created successfully Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e3e0a8-603d-4efe-aa32-e1951c7cb780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Flow 'volume_create_manager' (0d7e0419-8955-4f4f-aa1b-286a5b1f2472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e662400f-cd58-472b-adb6-5fe3d6d6cbba tempest-VolumesSnapshotTestJSON-1253256666 None] Created volume successfully. Aug 26 16:17:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:17:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:17 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:17:17 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:18 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.301s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:17:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:17:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 28 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:17:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:17:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] Creating offline snapshot 141e9f4c-fa03-47d4-a875-cb57c1a96a38 of volume 063801ab-4057-4636-a8ae-5068ccf86443 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:17:18 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe2762-f290-4dc9-b4a7-d92ba2f00bf6]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:18 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 Aug 26 16:17:18 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:18 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443" returned: 0 in 0.380s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:18 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 1G Aug 26 16:17:18 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:19 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 1G" returned: 0 in 0.660s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-063801ab-4057-4636-a8ae-5068ccf86443 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:19 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-063801ab-4057-4636-a8ae-5068ccf86443 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 Aug 26 16:17:19 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:19 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-063801ab-4057-4636-a8ae-5068ccf86443 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38" returned: 0 in 0.377s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:19 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 is being set with open permissions: ugo+rw Aug 26 16:17:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:19 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 Aug 26 16:17:19 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:20 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38" returned: 0 in 0.505s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:20 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.info Aug 26 16:17:20 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:20 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.info" returned: 0 in 0.405s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:20 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.info is being set with open permissions: ugo+rw Aug 26 16:17:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:20 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.info Aug 26 16:17:20 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Flow 'volume_create_manager' (317e9f4f-5087-4c26-928a-3281fbfe5384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eed9942-224a-4689-8834-41bdcf739f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:21 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.info" returned: 0 in 0.432s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.904s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eed9942-224a-4689-8834-41bdcf739f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1661012571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5419dc-52b7-438d-bab3-80a2b87d10bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9a71223ce74779831aa3e82057b9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:21Z,use_quota=True,user_id='e2cfe4685ba14e27b4814e8323f9f054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f07c500-726a-4a20-83d3-aae71fd59f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f07c500-726a-4a20-83d3-aae71fd59f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26faf9c9-0dfc-4bed-856d-b76ab0a0af02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26faf9c9-0dfc-4bed-856d-b76ab0a0af02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf5419dc-52b7-438d-bab3-80a2b87d10bf', 'volume_name': 'volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5319f5a-5674-4bff-b5ba-af4006406f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5319f5a-5674-4bff-b5ba-af4006406f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b09b1cf7-7206-4443-ab07-2725e20f623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:21 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Volume cf5419dc-52b7-438d-bab3-80a2b87d10bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf', 'volume_size': 1} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1661012571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5419dc-52b7-438d-bab3-80a2b87d10bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9a71223ce74779831aa3e82057b9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:21Z,use_quota=True,user_id='e2cfe4685ba14e27b4814e8323f9f054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Creating volume cf5419dc-52b7-438d-bab3-80a2b87d10bf {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:17:21 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:21 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2f1c1c0f-a513-49f8-9bb3-d38cdb6f3934 tempest-VolumesSnapshotTestJSON-1253256666 None] Create snapshot completed successfully Aug 26 16:17:21 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf 1073741824 Aug 26 16:17:21 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:21 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf 1073741824" returned: 0 in 0.623s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:22 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf Aug 26 16:17:22 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:22 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf" returned: 0 in 0.394s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b09b1cf7-7206-4443-ab07-2725e20f623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac820b1-1d58-420c-abf8-bd80a48cb5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:22 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Volume volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf (cf5419dc-52b7-438d-bab3-80a2b87d10bf): created successfully Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac820b1-1d58-420c-abf8-bd80a48cb5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Flow 'volume_create_manager' (317e9f4f-5087-4c26-928a-3281fbfe5384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:22 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6de88768-0c2d-4c53-abf8-24a75852798e tempest-AttachVolumeTestJSON-570178932 None] Created volume successfully. Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Flow 'volume_create_manager' (4095abff-ce58-4c24-9070-ee1e48703c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4cc938-ea98-492e-9067-87b2754a4500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4cc938-ea98-492e-9067-87b2754a4500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-547563147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6df02054c44710b825d2d2a5e3c511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=141e9f4c-fa03-47d4-a875-cb57c1a96a38,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:22Z,use_quota=True,user_id='acd693be3fce4fa199b2e01b2d03b647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f756785a-ac92-4034-90d8-e4dc6fe1e4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f756785a-ac92-4034-90d8-e4dc6fe1e4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b254f3b-0d59-4ff1-9cc8-acfa7572ebfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b254f3b-0d59-4ff1-9cc8-acfa7572ebfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78', 'volume_name': 'volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78', 'volume_size': 2, 'snapshot_id': '141e9f4c-fa03-47d4-a875-cb57c1a96a38'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c519345-a6a9-4886-9118-12e25c1378a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c519345-a6a9-4886-9118-12e25c1378a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9161f4e3-c187-4c2c-b897-c82b191ef240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:22 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Volume 9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78', 'volume_size': 2, 'snapshot_id': '141e9f4c-fa03-47d4-a875-cb57c1a96a38'} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-141e9f4c-fa03-47d4-a875-cb57c1a96a38-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78" by "_create_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-141e9f4c-fa03-47d4-a875-cb57c1a96a38-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Creating volume 9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78 from snapshot 141e9f4c-fa03-47d4-a875-cb57c1a96a38 {{(pid=94407) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78" by "_copy_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] snapshot: 141e9f4c-fa03-47d4-a875-cb57c1a96a38, volume: 9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78, {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca84c32-4d58-40b0-ad52-a64e1817ba37]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:22 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 Aug 26 16:17:22 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:23 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38" returned: 0 in 0.359s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-063801ab-4057-4636-a8ae-5068ccf86443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:17:23 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[358a571f-e0eb-4a13-ac57-c7957ffa9eed]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:23 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 Aug 26 16:17:23 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:23 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443" returned: 0 in 0.400s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] will copy from snapshot at /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 16:17:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Creating direct copy from snapshot {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 16:17:23 devstack cinder-volume[94407]: DEBUG cinder.utils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Path /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78 not found in is_blk_device check {{(pid=94407) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 16:17:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:23 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78 Aug 26 16:17:23 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-a98173ca-ed50-44aa-8092-52c867a939a3 req-34268c41-2330-4bde-a494-f00d9bceebad tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:27 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-24ac8d45-eaa7-48f4-a051-8f1280670a4a req-9f7908fb-7dc5-4564-ae2f-f5d6eb5e9210 tempest-AttachVolumeNegativeTest-1059842712 None] Terminate volume connection completed successfully. Aug 26 16:17:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-24ac8d45-eaa7-48f4-a051-8f1280670a4a req-9f7908fb-7dc5-4564-ae2f-f5d6eb5e9210 tempest-AttachVolumeNegativeTest-1059842712 None] Deleting attachment e0843050-26a4-45c9-9dc9-535941b119b9. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:17:28 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78" returned: 0 in 5.320s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:28 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78 {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:17:28 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Converted 1024.00 MB image at 192.43 MB/s Aug 26 16:17:28 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78 is being set with open permissions: ugo+rw Aug 26 16:17:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:28 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78 Aug 26 16:17:28 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:29 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78" returned: 0 in 0.274s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78" released by "_copy_volume_from_snapshot" :: held 6.445s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-141e9f4c-fa03-47d4-a875-cb57c1a96a38-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78" released by "_create_volume_from_snapshot" :: held 6.515s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.533s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-a98173ca-ed50-44aa-8092-52c867a939a3 req-34268c41-2330-4bde-a494-f00d9bceebad tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.187s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-a98173ca-ed50-44aa-8092-52c867a939a3 req-34268c41-2330-4bde-a494-f00d9bceebad tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9161f4e3-c187-4c2c-b897-c82b191ef240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78', 'volume_size': 2, 'snapshot_id': '141e9f4c-fa03-47d4-a875-cb57c1a96a38'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bc19ee-1bb0-4255-b8c0-c6be927985a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:29 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Volume volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78 (9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78): created successfully Aug 26 16:17:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bc19ee-1bb0-4255-b8c0-c6be927985a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Flow 'volume_create_manager' (4095abff-ce58-4c24-9070-ee1e48703c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-a98173ca-ed50-44aa-8092-52c867a939a3 req-34268c41-2330-4bde-a494-f00d9bceebad tempest-AttachVolumeTestJSON-570178932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd9eb343-fe8a-497a-812b-17c9e0febe11', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:17:29 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-533664be-07a4-499b-8f1b-eab55dbe0f50 tempest-VolumesSnapshotTestJSON-1253256666 None] Created volume successfully. Aug 26 16:17:29 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-a98173ca-ed50-44aa-8092-52c867a939a3 req-34268c41-2330-4bde-a494-f00d9bceebad tempest-AttachVolumeTestJSON-570178932 None] attachment_update completed successfully. Aug 26 16:17:30 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:30 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:30 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:30 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:30 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[841157e7-8bc0-4697-a7a8-aaa5b9fac6fd]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:30 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78 Aug 26 16:17:30 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:30 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78" returned: 0 in 0.465s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:30 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78 Aug 26 16:17:30 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:31 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78" returned: 0 in 0.287s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78" released by "delete_volume" :: held 0.817s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Created reservations ['44666a2d-0d22-4d97-8e60-a02a562d4ea0', '86665b33-962a-4008-b345-ac5f5008d90a', 'd1742e06-dbd9-4674-9e66-c03658b9fa50', '176bcedc-36b8-49d9-a38d-3fbf1ba82f43'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:31 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:17:31 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-141e9f4c-fa03-47d4-a875-cb57c1a96a38-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-141e9f4c-fa03-47d4-a875-cb57c1a96a38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-063801ab-4057-4636-a8ae-5068ccf86443" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Flow 'volume_create_manager' (38a6566b-a816-48c0-bb3c-56dbfbe6086b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9257b4-2b8d-440b-a056-0f25a8d9467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-063801ab-4057-4636-a8ae-5068ccf86443" acquired by "delete_snapshot" :: waited 0.055s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-141e9f4c-fa03-47d4-a875-cb57c1a96a38" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9257b4-2b8d-440b-a056-0f25a8d9467a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-317738991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599ff2a5-d1ed-4351-bdf7-89762480e4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9a71223ce74779831aa3e82057b9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:32Z,use_quota=True,user_id='e2cfe4685ba14e27b4814e8323f9f054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fda55e-3e35-41ec-9bdd-e9e3b3eefcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fda55e-3e35-41ec-9bdd-e9e3b3eefcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7ff88b-6c01-4dae-b9b7-cf3e53657933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7ff88b-6c01-4dae-b9b7-cf3e53657933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '599ff2a5-d1ed-4351-bdf7-89762480e4f6', 'volume_name': 'volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd0e121-6756-4e52-b848-4b45f5a12904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd0e121-6756-4e52-b848-4b45f5a12904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0237aba4-c02d-4920-ab17-c2214d2e8f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:31 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Volume 599ff2a5-d1ed-4351-bdf7-89762480e4f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6', 'volume_size': 1} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-317738991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599ff2a5-d1ed-4351-bdf7-89762480e4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9a71223ce74779831aa3e82057b9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:32Z,use_quota=True,user_id='e2cfe4685ba14e27b4814e8323f9f054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Creating volume 599ff2a5-d1ed-4351-bdf7-89762480e4f6 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:17:31 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:31 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-141e9f4c-fa03-47d4-a875-cb57c1a96a38" acquired by "_delete_snapshot" :: waited 0.094s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Deleting offline snapshot 141e9f4c-fa03-47d4-a875-cb57c1a96a38 of volume 063801ab-4057-4636-a8ae-5068ccf86443 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:17:31 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6 1073741824 Aug 26 16:17:31 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] snapshot_file for this snap is: volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.381s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:17:31 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Deleted volume successfully. Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eeba07-4abe-42e4-bd79-2f379a511813]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b08772b0-ac33-4550-96cb-ffcdeb127399 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-9ae28c80-a36d-4ad3-a8e4-eeeccbb66d78-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:31 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 Aug 26 16:17:31 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:32 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6 1073741824" returned: 0 in 0.504s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:32 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38" returned: 0 in 0.427s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-063801ab-4057-4636-a8ae-5068ccf86443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[3300437d-43c0-4857-8a6a-3c204ea5eeb8]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:32 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6 Aug 26 16:17:32 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:32 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 Aug 26 16:17:32 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:32 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6" returned: 0 in 0.258s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0237aba4-c02d-4920-ab17-c2214d2e8f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce6ac58-6e9a-4e3f-814f-31939436b822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:32 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Volume volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6 (599ff2a5-d1ed-4351-bdf7-89762480e4f6): created successfully Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce6ac58-6e9a-4e3f-814f-31939436b822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Flow 'volume_create_manager' (38a6566b-a816-48c0-bb3c-56dbfbe6086b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:32 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f2f924af-113d-4fa8-8054-fbe007b59e2b tempest-AttachVolumeTestJSON-570178932 None] Created volume successfully. Aug 26 16:17:32 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443" returned: 0 in 0.537s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:32 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 Aug 26 16:17:32 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:33 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38" returned: 0 in 0.410s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:33 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38 Aug 26 16:17:33 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:33 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443.141e9f4c-fa03-47d4-a875-cb57c1a96a38" returned: 0 in 0.303s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:33 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-141e9f4c-fa03-47d4-a875-cb57c1a96a38" released by "_delete_snapshot" :: held 1.820s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:33 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-063801ab-4057-4636-a8ae-5068ccf86443" released by "delete_snapshot" :: held 1.929s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:33 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Created reservations ['ee2dd5a2-7257-4e8c-a1cc-0aff4feb8073', '8662a4d8-984a-4af3-90f6-4e82db94e8af', 'fe53dfa0-dbab-4848-8642-fd41a1e5f650', 'e00b2479-4df6-49d8-8867-54e3f4237734'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:17:33 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Delete snapshot completed successfully. Aug 26 16:17:33 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bb2d324c-cb80-40fb-8803-e6566054397c tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-141e9f4c-fa03-47d4-a875-cb57c1a96a38-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-37d78eca-49cf-4043-807c-47de6b315323 req-b21a28a8-482d-4045-8be5-73effd619a8a tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-37d78eca-49cf-4043-807c-47de6b315323 req-b21a28a8-482d-4045-8be5-73effd619a8a tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-37d78eca-49cf-4043-807c-47de6b315323 req-b21a28a8-482d-4045-8be5-73effd619a8a tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-37d78eca-49cf-4043-807c-47de6b315323 req-b21a28a8-482d-4045-8be5-73effd619a8a tempest-AttachVolumeTestJSON-570178932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd64549aa-4fb2-47a8-a277-a49f42ad9d4a', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:17:34 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-37d78eca-49cf-4043-807c-47de6b315323 req-b21a28a8-482d-4045-8be5-73effd619a8a tempest-AttachVolumeTestJSON-570178932 None] attachment_update completed successfully. Aug 26 16:17:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-063801ab-4057-4636-a8ae-5068ccf86443-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-063801ab-4057-4636-a8ae-5068ccf86443-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-063801ab-4057-4636-a8ae-5068ccf86443" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-063801ab-4057-4636-a8ae-5068ccf86443" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[8853264e-593f-44d8-a8f8-a6e3aa962100]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:35 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 Aug 26 16:17:35 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:35 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443" returned: 0 in 0.454s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:35 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443 Aug 26 16:17:35 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:35 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-063801ab-4057-4636-a8ae-5068ccf86443" returned: 0 in 0.278s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-063801ab-4057-4636-a8ae-5068ccf86443" released by "delete_volume" :: held 0.806s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Created reservations ['84ff67b0-a3ce-462d-ad85-e47660890e94', 'ef388561-6adb-4eb8-b7dc-c8b08c3fd101', 'ae8d29df-1212-4f03-bcb6-9806ca2e7cca', 'd29d9ee0-fc4d-4068-ad6e-6f4847934d7b'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:36 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:17:36 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:36 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.341s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:17:36 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Deleted volume successfully. Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Flow 'volume_create_manager' (562c95b8-31cd-4175-81ad-e7bfb1ad2bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b29d40-30cb-4c85-a6e3-cb79f12ba794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b29d40-30cb-4c85-a6e3-cb79f12ba794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-286181906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c96ce28-40ba-414f-960d-a14e3a4f7222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df07ab3f15a47f097f50e1a9d854dca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:36Z,use_quota=True,user_id='f1802faf3b4844f780e69eccf6f0dfed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbc71da-54ca-4767-a0da-91689d8f1cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbc71da-54ca-4767-a0da-91689d8f1cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259172f1-5921-42ae-bdbe-4180f38b6f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259172f1-5921-42ae-bdbe-4180f38b6f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c96ce28-40ba-414f-960d-a14e3a4f7222', 'volume_name': 'volume-3c96ce28-40ba-414f-960d-a14e3a4f7222', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96107373-1ccb-4661-bcf1-aceb98193813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96107373-1ccb-4661-bcf1-aceb98193813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a494c169-5cd5-47cf-8d4a-aba1992c5df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:36 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Volume 3c96ce28-40ba-414f-960d-a14e3a4f7222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c96ce28-40ba-414f-960d-a14e3a4f7222', 'volume_size': 1} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-286181906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c96ce28-40ba-414f-960d-a14e3a4f7222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df07ab3f15a47f097f50e1a9d854dca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:36Z,use_quota=True,user_id='f1802faf3b4844f780e69eccf6f0dfed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Creating volume 3c96ce28-40ba-414f-960d-a14e3a4f7222 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:17:36 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3c96ce28-40ba-414f-960d-a14e3a4f7222 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c00b6306-f782-4378-9efc-477e3b069e0d tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-063801ab-4057-4636-a8ae-5068ccf86443-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:36 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3c96ce28-40ba-414f-960d-a14e3a4f7222 1073741824 Aug 26 16:17:36 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Flow 'volume_create_manager' (9b18e5b8-5ab1-455d-9930-19033e25f296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f015f66c-cdf9-4392-8364-5cab967ede8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f015f66c-cdf9-4392-8364-5cab967ede8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1963588025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6df02054c44710b825d2d2a5e3c511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:37Z,use_quota=True,user_id='acd693be3fce4fa199b2e01b2d03b647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b526bed-89cc-4370-afce-84ff504e8819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b526bed-89cc-4370-afce-84ff504e8819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb3d213-fb1f-4a01-97eb-9131f7667da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb3d213-fb1f-4a01-97eb-9131f7667da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd', 'volume_name': 'volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5397bc-dbd0-4c0e-8a52-056d9ef78cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5397bc-dbd0-4c0e-8a52-056d9ef78cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97933a0-c4ee-41b0-8c85-5acfba6df758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:36 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Volume 4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd', 'volume_size': 1} Aug 26 16:17:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:37 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3c96ce28-40ba-414f-960d-a14e3a4f7222 1073741824" returned: 0 in 0.611s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3c96ce28-40ba-414f-960d-a14e3a4f7222 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:37 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3c96ce28-40ba-414f-960d-a14e3a4f7222 Aug 26 16:17:37 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:37 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3c96ce28-40ba-414f-960d-a14e3a4f7222" returned: 0 in 0.267s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1963588025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6df02054c44710b825d2d2a5e3c511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:37Z,use_quota=True,user_id='acd693be3fce4fa199b2e01b2d03b647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Creating volume 4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:17:37 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a494c169-5cd5-47cf-8d4a-aba1992c5df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c96ce28-40ba-414f-960d-a14e3a4f7222', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5d1e34-c9c9-4378-8522-cffd71fb4ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:37 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd 1073741824 Aug 26 16:17:37 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:37 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Volume volume-3c96ce28-40ba-414f-960d-a14e3a4f7222 (3c96ce28-40ba-414f-960d-a14e3a4f7222): created successfully Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5d1e34-c9c9-4378-8522-cffd71fb4ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Flow 'volume_create_manager' (562c95b8-31cd-4175-81ad-e7bfb1ad2bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5eb798db-6259-459e-bf54-7d859214a55c tempest-AttachVolumeShelveTestJSON-506015742 None] Created volume successfully. Aug 26 16:17:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-379d4e81-69eb-472d-8618-762ac846f579 req-e0b3d4c5-1c62-4110-be21-7ed193495321 tempest-AttachVolumeTestJSON-570178932 None] Terminate volume connection completed successfully. Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-379d4e81-69eb-472d-8618-762ac846f579 req-e0b3d4c5-1c62-4110-be21-7ed193495321 tempest-AttachVolumeTestJSON-570178932 None] Deleting attachment cd9eb343-fe8a-497a-812b-17c9e0febe11. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:17:37 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd 1073741824" returned: 0 in 0.543s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:37 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd Aug 26 16:17:37 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:38 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd" returned: 0 in 0.267s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:38 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:17:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97933a0-c4ee-41b0-8c85-5acfba6df758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13721c3c-7004-4a3e-898e-96f9fa427487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:38 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Volume volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd (4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd): created successfully Aug 26 16:17:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13721c3c-7004-4a3e-898e-96f9fa427487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Flow 'volume_create_manager' (9b18e5b8-5ab1-455d-9930-19033e25f296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:38 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e60b276b-97e0-4244-b134-5c65f341841b tempest-VolumesSnapshotTestJSON-1253256666 None] Created volume successfully. Aug 26 16:17:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] Creating offline snapshot ea2711c9-0b0a-4720-ac52-6fab1e39ca25 of volume 4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:17:39 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[147ffbd5-38fa-450a-8871-2006c2cc097a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:39 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-54f64ddc-7891-4e4c-906c-91d66e1cf9d2 req-9aeb21f4-c859-4839-b429-291cdedce0f7 tempest-AttachVolumeTestJSON-570178932 None] Terminate volume connection completed successfully. Aug 26 16:17:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-54f64ddc-7891-4e4c-906c-91d66e1cf9d2 req-9aeb21f4-c859-4839-b429-291cdedce0f7 tempest-AttachVolumeTestJSON-570178932 None] Deleting attachment d64549aa-4fb2-47a8-a277-a49f42ad9d4a. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:17:39 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd Aug 26 16:17:39 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:39 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd" returned: 0 in 0.511s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:39 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 1G Aug 26 16:17:39 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:40 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 1G" returned: 0 in 0.729s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:40 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 Aug 26 16:17:40 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:41 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25" returned: 0 in 0.425s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:41 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 is being set with open permissions: ugo+rw Aug 26 16:17:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:41 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 Aug 26 16:17:41 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:41 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25" returned: 0 in 0.494s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:41 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.info Aug 26 16:17:41 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:41 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.info" returned: 0 in 0.443s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:42 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.info is being set with open permissions: ugo+rw Aug 26 16:17:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:42 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.info Aug 26 16:17:42 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:42 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.info" returned: 0 in 0.439s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.197s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:42 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e4f5776e-ce86-4e48-b5b3-b0221ce35e20 tempest-VolumesSnapshotTestJSON-1253256666 None] Create snapshot completed successfully Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Flow 'volume_create_manager' (02d6fd22-1db9-404c-bbcb-bcfcd0c1152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7727849f-60e5-45e4-b3da-075ae873a6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7727849f-60e5-45e4-b3da-075ae873a6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-957736235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63260948-e004-4543-ab29-83bed8ff4cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee6df02054c44710b825d2d2a5e3c511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ea2711c9-0b0a-4720-ac52-6fab1e39ca25,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:17:45Z,use_quota=True,user_id='acd693be3fce4fa199b2e01b2d03b647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b18856-36d0-4b38-a02f-ab712ffd47a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b18856-36d0-4b38-a02f-ab712ffd47a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f69127-e56a-4c8f-baf4-7b24b5ddca54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f69127-e56a-4c8f-baf4-7b24b5ddca54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '63260948-e004-4543-ab29-83bed8ff4cf1', 'volume_name': 'volume-63260948-e004-4543-ab29-83bed8ff4cf1', 'volume_size': 1, 'snapshot_id': 'ea2711c9-0b0a-4720-ac52-6fab1e39ca25'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6f7cd3-a84c-49e0-aee1-0ad482171db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6f7cd3-a84c-49e0-aee1-0ad482171db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66cf2817-a728-45fe-ba8b-8544eb6f80e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:45 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Volume 63260948-e004-4543-ab29-83bed8ff4cf1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-63260948-e004-4543-ab29-83bed8ff4cf1', 'volume_size': 1, 'snapshot_id': 'ea2711c9-0b0a-4720-ac52-6fab1e39ca25'} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-ea2711c9-0b0a-4720-ac52-6fab1e39ca25-63260948-e004-4543-ab29-83bed8ff4cf1" by "_create_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-ea2711c9-0b0a-4720-ac52-6fab1e39ca25-63260948-e004-4543-ab29-83bed8ff4cf1" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Creating volume 63260948-e004-4543-ab29-83bed8ff4cf1 from snapshot ea2711c9-0b0a-4720-ac52-6fab1e39ca25 {{(pid=94407) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-63260948-e004-4543-ab29-83bed8ff4cf1" by "_copy_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-63260948-e004-4543-ab29-83bed8ff4cf1" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] snapshot: ea2711c9-0b0a-4720-ac52-6fab1e39ca25, volume: 63260948-e004-4543-ab29-83bed8ff4cf1, {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbc883d-9265-4ad1-b7c7-be8b14754f65]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:45 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 Aug 26 16:17:45 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "cinder-599ff2a5-d1ed-4351-bdf7-89762480e4f6-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Lock "cinder-599ff2a5-d1ed-4351-bdf7-89762480e4f6-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:46 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25" returned: 0 in 0.701s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca40596-c56b-40e3-9def-a674e2b37ad1]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "cinder-quobyte-599ff2a5-d1ed-4351-bdf7-89762480e4f6" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Lock "cinder-quobyte-599ff2a5-d1ed-4351-bdf7-89762480e4f6" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[5293375c-e5e3-40c0-9cda-51346ebb1ae9]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:46 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd Aug 26 16:17:46 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:46 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6 Aug 26 16:17:46 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:46 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6" returned: 0 in 0.540s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:46 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6 Aug 26 16:17:46 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:46 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd" returned: 0 in 0.691s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] will copy from snapshot at /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Creating direct copy from snapshot {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG cinder.utils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Path /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1 not found in is_blk_device check {{(pid=94407) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 16:17:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:46 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1 Aug 26 16:17:46 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:47 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-599ff2a5-d1ed-4351-bdf7-89762480e4f6" returned: 0 in 0.356s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Lock "cinder-quobyte-599ff2a5-d1ed-4351-bdf7-89762480e4f6" released by "delete_volume" :: held 0.958s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:47 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Created reservations ['57adaeb3-0e7b-4297-a344-9e82ac32c5d6', '9f21dcda-02a7-43f3-ad2f-112616b15acb', 'd165fa7a-7e34-46c5-8731-3fdfa7ef2faa', 'b17561f4-b14b-43c2-9705-69fe1524ef39'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:17:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:47 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:17:47 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:47 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.380s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:47 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:17:47 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Deleted volume successfully. Aug 26 16:17:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-35c32b22-fc92-44fe-b9ba-67ef484276d6 tempest-AttachVolumeTestJSON-570178932 None] Lock "cinder-599ff2a5-d1ed-4351-bdf7-89762480e4f6-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "cinder-cf5419dc-52b7-438d-bab3-80a2b87d10bf-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Lock "cinder-cf5419dc-52b7-438d-bab3-80a2b87d10bf-delete_volume" acquired by "delete_volume" :: waited 0.148s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "cinder-quobyte-cf5419dc-52b7-438d-bab3-80a2b87d10bf" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Lock "cinder-quobyte-cf5419dc-52b7-438d-bab3-80a2b87d10bf" acquired by "delete_volume" :: waited 0.150s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:49 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2ffcbb-eef0-42b9-a22b-365cbb95d5c6]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:50 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf Aug 26 16:17:50 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:51 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf" returned: 0 in 2.073s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:51 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf Aug 26 16:17:51 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cf5419dc-52b7-438d-bab3-80a2b87d10bf" returned: 0 in 1.264s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:52 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:52 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Lock "cinder-quobyte-cf5419dc-52b7-438d-bab3-80a2b87d10bf" released by "delete_volume" :: held 3.575s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:52 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Created reservations ['2ca428c6-4063-497f-bae7-d2cce9f7defc', 'c9d08e29-0dfd-4ebb-ae40-a71222fe9c4c', '50a91a42-8fc0-438c-9b46-751c9bf12b3a', '316ab843-7070-4312-b739-db1aa8d12c7e'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:17:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:53 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:53 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:53 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:17:53 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:54 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 1.221s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:54 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:17:54 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Deleted volume successfully. Aug 26 16:17:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ce24e93b-1dec-4c90-827a-29a36488b7d6 tempest-AttachVolumeTestJSON-570178932 None] Lock "cinder-cf5419dc-52b7-438d-bab3-80a2b87d10bf-delete_volume" released by "delete_volume" :: held 5.894s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "cinder-4303755b-2e83-4b2e-b128-87e2dd475572-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Lock "cinder-4303755b-2e83-4b2e-b128-87e2dd475572-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "cinder-quobyte-4303755b-2e83-4b2e-b128-87e2dd475572" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Lock "cinder-quobyte-4303755b-2e83-4b2e-b128-87e2dd475572" acquired by "delete_volume" :: waited 0.031s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:55 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b458391-3466-458c-afca-22c09d0dfa21]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4303755b-2e83-4b2e-b128-87e2dd475572 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:55 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4303755b-2e83-4b2e-b128-87e2dd475572 Aug 26 16:17:55 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:55 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1" returned: 0 in 9.104s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:55 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd, size 1024.00 MB, duration 9.10 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1 {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:17:55 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Converted 1024.00 MB image at 112.47 MB/s Aug 26 16:17:55 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1 is being set with open permissions: ugo+rw Aug 26 16:17:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:56 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1 Aug 26 16:17:56 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:56 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4303755b-2e83-4b2e-b128-87e2dd475572" returned: 0 in 1.202s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4303755b-2e83-4b2e-b128-87e2dd475572 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:56 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1" returned: 0 in 0.461s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:56 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4303755b-2e83-4b2e-b128-87e2dd475572 Aug 26 16:17:56 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-63260948-e004-4543-ab29-83bed8ff4cf1" released by "_copy_volume_from_snapshot" :: held 11.192s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-ea2711c9-0b0a-4720-ac52-6fab1e39ca25-63260948-e004-4543-ab29-83bed8ff4cf1" released by "_create_volume_from_snapshot" :: held 11.297s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.336s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66cf2817-a728-45fe-ba8b-8544eb6f80e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63260948-e004-4543-ab29-83bed8ff4cf1', 'volume_size': 1, 'snapshot_id': 'ea2711c9-0b0a-4720-ac52-6fab1e39ca25'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf9e9c5-7c79-4678-a90d-6dacad1842de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:17:56 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Volume volume-63260948-e004-4543-ab29-83bed8ff4cf1 (63260948-e004-4543-ab29-83bed8ff4cf1): created successfully Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf9e9c5-7c79-4678-a90d-6dacad1842de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Flow 'volume_create_manager' (02d6fd22-1db9-404c-bbcb-bcfcd0c1152a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:17:56 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0571ae20-8a37-4dd3-957b-d18e89621cf0 tempest-VolumesSnapshotTestJSON-1253256666 None] Created volume successfully. Aug 26 16:17:56 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4303755b-2e83-4b2e-b128-87e2dd475572" returned: 0 in 0.409s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Lock "cinder-quobyte-4303755b-2e83-4b2e-b128-87e2dd475572" released by "delete_volume" :: held 1.761s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Created reservations ['9381cb36-3e03-4724-81d0-21cf11524058', 'e3cbc749-9b6f-4ab8-bb87-16484f10b0e7', 'b24f946e-9a04-4f9c-ab40-27e4cd7bd63a', 'bf4d3ff3-4cd8-48bb-8ba0-b86e39dfbc18'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:56 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:17:56 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:57 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.334s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:57 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:17:57 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Deleted volume successfully. Aug 26 16:17:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-86f42142-3440-4eaf-81bc-93705745ac79 tempest-AttachVolumeTestJSON-570178932 None] Lock "cinder-4303755b-2e83-4b2e-b128-87e2dd475572-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-9cf2fcd5-e0e7-4b1a-9cc0-2626db2e4ed1 req-740a3ff5-3ce8-485e-8dbe-738c016be06f tempest-AttachVolumeShelveTestJSON-506015742 None] No connector for attachment 0afbe01c-7b9c-49c3-82b6-d123a9f8ca27; skipping storage backend terminate_connection call. {{(pid=94407) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 26 16:17:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-9cf2fcd5-e0e7-4b1a-9cc0-2626db2e4ed1 req-740a3ff5-3ce8-485e-8dbe-738c016be06f tempest-AttachVolumeShelveTestJSON-506015742 None] Deleting attachment 0afbe01c-7b9c-49c3-82b6-d123a9f8ca27. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:17:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-63260948-e004-4543-ab29-83bed8ff4cf1-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-63260948-e004-4543-ab29-83bed8ff4cf1-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-63260948-e004-4543-ab29-83bed8ff4cf1" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:17:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-63260948-e004-4543-ab29-83bed8ff4cf1" acquired by "delete_volume" :: waited 0.040s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:17:58 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f9a313-a1e4-4bef-aef2-b3024bd54e5b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:17:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:58 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1 Aug 26 16:17:58 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:58 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1" returned: 0 in 0.512s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:59 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1 Aug 26 16:17:59 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:59 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-63260948-e004-4543-ab29-83bed8ff4cf1" returned: 0 in 0.392s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-63260948-e004-4543-ab29-83bed8ff4cf1" released by "delete_volume" :: held 1.006s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=99,cinder:INSERT=20,cinder:UPDATE=77,cinder:DELETE=10 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=82,cinder:UPDATE=90,cinder:INSERT=19,cinder:DELETE=6 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Created reservations ['6ce41259-7093-441a-9d16-8969a2e42fb7', '0c57cd6a-3d44-4826-831a-b1e43d349458', '44d7c49a-a37e-4c9c-ba65-d08ee407352a', 'd1e91a2b-8601-42f4-a1c2-ea138a331fd8'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:17:59 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:17:59 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:17:59 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.326s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:17:59 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:17:59 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Deleted volume successfully. Aug 26 16:18:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4ff53c1c-90a4-4eb6-af3f-024b7bc24bbd tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-63260948-e004-4543-ab29-83bed8ff4cf1-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:18:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-ea2711c9-0b0a-4720-ac52-6fab1e39ca25-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:18:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-ea2711c9-0b0a-4720-ac52-6fab1e39ca25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:18:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:18:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:18:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-ea2711c9-0b0a-4720-ac52-6fab1e39ca25" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:18:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-ea2711c9-0b0a-4720-ac52-6fab1e39ca25" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:18:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Deleting offline snapshot ea2711c9-0b0a-4720-ac52-6fab1e39ca25 of volume 4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:18:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] snapshot_file for this snap is: volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:18:00 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5150429-40aa-46a7-8b27-1489536ebeab]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:18:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:00 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 Aug 26 16:18:00 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:01 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25" returned: 0 in 0.368s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:18:01 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e0c49e-1572-4981-bafc-02f0457cfcc4]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:18:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:01 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd Aug 26 16:18:01 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:01 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd" returned: 0 in 0.657s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:01 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 Aug 26 16:18:01 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:02 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25" returned: 0 in 0.482s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:02 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25 Aug 26 16:18:02 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:02 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd.ea2711c9-0b0a-4720-ac52-6fab1e39ca25" returned: 0 in 0.457s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-ea2711c9-0b0a-4720-ac52-6fab1e39ca25" released by "_delete_snapshot" :: held 2.123s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:18:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd" released by "delete_snapshot" :: held 2.156s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:18:03 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Created reservations ['6756e90b-2f52-4e17-8b1c-c547d6702ba4', '83d23ada-a6ec-4ed9-bc8d-17ccc518ae1a', '0ed814ee-f405-4cb1-b1ec-8e8e06621c98', '302d05c8-45a6-48be-a1ed-f7c912bcbbe7'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:18:03 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Delete snapshot completed successfully. Aug 26 16:18:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-152c7571-fdf7-4c60-afad-d06c4fc19d8a tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-ea2711c9-0b0a-4720-ac52-6fab1e39ca25-delete_snapshot" released by "delete_snapshot" :: held 2.384s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:18:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:18:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:18:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:18:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd" acquired by "delete_volume" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:18:04 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1944c38-1f66-430e-a2e4-55505affab87]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:18:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:04 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd Aug 26 16:18:04 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:04 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd" returned: 0 in 0.399s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:04 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd Aug 26 16:18:04 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:04 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd" returned: 0 in 0.292s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd" released by "delete_volume" :: held 0.773s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Created reservations ['53883db6-34fe-4b8a-bcd2-ba92a7f256bb', '4b97256e-1b7f-4fc4-989d-01922a743240', '0e75f5ff-5d29-468b-87a1-3f0b022965d9', '52f591cc-816e-41ff-8df8-88aaf7a10898'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:05 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:18:05 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-2ebe3d1f-3b16-4471-9ab5-c709b581f269-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-2ebe3d1f-3b16-4471-9ab5-c709b581f269-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "cinder-quobyte-2ebe3d1f-3b16-4471-9ab5-c709b581f269" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:18:05 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.442s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-2ebe3d1f-3b16-4471-9ab5-c709b581f269" acquired by "delete_volume" :: waited 0.034s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:18:05 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Deleted volume successfully. Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1a9cfe-5f93-420f-a00c-92d18aeabfce]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-30b9860b-5e43-4a21-823e-6df065f2eba0 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-4f71ea6e-95e7-47bd-a9d2-3cc812cc38dd-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:18:05 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 Aug 26 16:18:05 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:06 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269" returned: 0 in 0.572s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:06 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269 Aug 26 16:18:06 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:06 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2ebe3d1f-3b16-4471-9ab5-c709b581f269" returned: 0 in 0.287s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-quobyte-2ebe3d1f-3b16-4471-9ab5-c709b581f269" released by "delete_volume" :: held 1.005s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:18:06 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Created reservations ['4f16487d-2414-4deb-913a-6334d4912198', '64e62405-46ac-4a68-b12d-9adbb4a08f3d', '69059ee3-131f-4764-a074-1a7db6f9893f', '768e40e8-c610-4666-b101-680a956444a8'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:18:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:18:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:18:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:18:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:18:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:18:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-811aeedd-59d6-4a07-8698-a58f859ec25d tempest-BackendsCapabilitiesAdminTestsJSON-1981950475 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.81400680542, 'free_capacity_gb': 1774.81400680542, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94407) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 16:18:06 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:18:06 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f54b84d2-72aa-492b-90ee-6db9aa6c8147 tempest-BackendsCapabilitiesAdminTestsJSON-1981950475 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.81400680542, 'free_capacity_gb': 1774.81400680542, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94407) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 16:18:07 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.329s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:07 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:18:07 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Deleted volume successfully. Aug 26 16:18:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9917f4ad-8c72-4c1f-9ee5-1a49e293ce06 tempest-VolumesSnapshotTestJSON-1253256666 None] Lock "cinder-2ebe3d1f-3b16-4471-9ab5-c709b581f269-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Flow 'volume_create_manager' (52addf99-9336-4fb7-a2b7-1dd0a9bd55b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095c50c5-4991-4902-803f-c9dd3ef95019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095c50c5-4991-4902-803f-c9dd3ef95019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1039581302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed832d6a-6983-42f9-baa8-ea24b0daccb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bfcc12896e4aa4ac89644635572619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:18:11Z,use_quota=True,user_id='14b14cc0e709467f8966b109d01b7168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13abed1c-de34-4427-8c96-46e1816ddb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13abed1c-de34-4427-8c96-46e1816ddb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5f287a-ddee-409e-a82e-f405383738d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5f287a-ddee-409e-a82e-f405383738d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed832d6a-6983-42f9-baa8-ea24b0daccb1', 'volume_name': 'volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0abbac-db0e-431b-a915-81b5c521f2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0abbac-db0e-431b-a915-81b5c521f2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c240f201-e5ee-4ad9-82e6-81c627c81ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:10 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Volume ed832d6a-6983-42f9-baa8-ea24b0daccb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1', 'volume_size': 1} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1039581302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed832d6a-6983-42f9-baa8-ea24b0daccb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bfcc12896e4aa4ac89644635572619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:18:11Z,use_quota=True,user_id='14b14cc0e709467f8966b109d01b7168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Creating volume ed832d6a-6983-42f9-baa8-ea24b0daccb1 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:18:10 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:18:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:10 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1 1073741824 Aug 26 16:18:10 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:11 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1 1073741824" returned: 0 in 0.794s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:11 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1 Aug 26 16:18:11 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:12 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1" returned: 0 in 0.359s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:18:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:18:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c240f201-e5ee-4ad9-82e6-81c627c81ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec56c5c-e661-445c-afc8-b94711b0fbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:12 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Volume volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1 (ed832d6a-6983-42f9-baa8-ea24b0daccb1): created successfully Aug 26 16:18:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec56c5c-e661-445c-afc8-b94711b0fbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Flow 'volume_create_manager' (52addf99-9336-4fb7-a2b7-1dd0a9bd55b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:18:12 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c13f6f03-9419-4a23-8964-f7e8efb357d9 tempest-AttachVolumeNegativeTest-1059842712 None] Created volume successfully. Aug 26 16:18:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-a289422e-4171-4505-83e4-2edacfcf05cf req-98a0101f-a5ee-4fcd-b907-49a2f2cb9887 tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:18:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-a289422e-4171-4505-83e4-2edacfcf05cf req-98a0101f-a5ee-4fcd-b907-49a2f2cb9887 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:18:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-a289422e-4171-4505-83e4-2edacfcf05cf req-98a0101f-a5ee-4fcd-b907-49a2f2cb9887 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:18:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-a289422e-4171-4505-83e4-2edacfcf05cf req-98a0101f-a5ee-4fcd-b907-49a2f2cb9887 tempest-AttachVolumeNegativeTest-1059842712 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '619e8f15-5b25-47d3-9764-3260d4095cdc', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:18:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-a289422e-4171-4505-83e4-2edacfcf05cf req-98a0101f-a5ee-4fcd-b907-49a2f2cb9887 tempest-AttachVolumeNegativeTest-1059842712 None] attachment_update completed successfully. Aug 26 16:18:17 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-93bf10be-e5c4-4d1e-8c77-d9a1f2d7ab9b req-437dc19d-22c1-42c8-b3b2-03451ab1da00 tempest-AttachVolumeNegativeTest-1059842712 None] Terminate volume connection completed successfully. Aug 26 16:18:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-93bf10be-e5c4-4d1e-8c77-d9a1f2d7ab9b req-437dc19d-22c1-42c8-b3b2-03451ab1da00 tempest-AttachVolumeNegativeTest-1059842712 None] Deleting attachment 619e8f15-5b25-47d3-9764-3260d4095cdc. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:18:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:18:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:18:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:18:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:18:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:18:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:18:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:18 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:18:18 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:18 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.537s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:18:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:18:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 28 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:18:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:18:27 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:INSERT=6,cinder:UPDATE=37,cinder:SELECT=24,cinder:DELETE=2 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:18:27 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=32,cinder:INSERT=11,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:18:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Acquiring lock "cinder-3c96ce28-40ba-414f-960d-a14e3a4f7222-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:18:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Lock "cinder-3c96ce28-40ba-414f-960d-a14e3a4f7222-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:18:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Acquiring lock "cinder-quobyte-3c96ce28-40ba-414f-960d-a14e3a4f7222" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:18:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Lock "cinder-quobyte-3c96ce28-40ba-414f-960d-a14e3a4f7222" acquired by "delete_volume" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:18:38 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[465a044c-ae2b-4aac-a3ef-e9a7767a1939]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:18:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3c96ce28-40ba-414f-960d-a14e3a4f7222 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:39 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3c96ce28-40ba-414f-960d-a14e3a4f7222 Aug 26 16:18:39 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:39 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3c96ce28-40ba-414f-960d-a14e3a4f7222" returned: 0 in 0.879s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3c96ce28-40ba-414f-960d-a14e3a4f7222 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:39 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3c96ce28-40ba-414f-960d-a14e3a4f7222 Aug 26 16:18:39 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:40 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3c96ce28-40ba-414f-960d-a14e3a4f7222" returned: 0 in 0.489s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Lock "cinder-quobyte-3c96ce28-40ba-414f-960d-a14e3a4f7222" released by "delete_volume" :: held 1.444s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Created reservations ['7118aa00-3ce6-4ddc-8443-ffe7548c230b', 'f01bc523-ed62-46e4-a58f-055dd7bbb025', '0bdb478e-d0e6-4ad7-9e67-543597fcde5c', 'b2f390af-9fd9-42f6-9782-781ac99c0329'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:40 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:18:40 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Flow 'volume_create_manager' (242ebcaf-edc8-48ff-9ca3-c44348db5168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a39afa6-cf96-4442-844d-bf94fa0ecc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a39afa6-cf96-4442-844d-bf94fa0ecc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-687250664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb8a186-042f-4712-9450-4d8e88246360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253d63b900124dc0984e62afd3b295b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:18:41Z,use_quota=True,user_id='235ca92f96a84ac0a5013d1f9a8bcbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ffb854-7b0d-442b-a352-355b20aa8df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ffb854-7b0d-442b-a352-355b20aa8df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3707f657-9df9-4d0b-8cf9-90bd9d3efae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3707f657-9df9-4d0b-8cf9-90bd9d3efae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb8a186-042f-4712-9450-4d8e88246360', 'volume_name': 'volume-8bb8a186-042f-4712-9450-4d8e88246360', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1b732c-c946-4aa9-8df3-b3a2bb08a7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1b732c-c946-4aa9-8df3-b3a2bb08a7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfd9906-8584-436a-a488-7739f32ee201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:41 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Volume 8bb8a186-042f-4712-9450-4d8e88246360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb8a186-042f-4712-9450-4d8e88246360', 'volume_size': 1} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-687250664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb8a186-042f-4712-9450-4d8e88246360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253d63b900124dc0984e62afd3b295b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:18:41Z,use_quota=True,user_id='235ca92f96a84ac0a5013d1f9a8bcbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Creating volume 8bb8a186-042f-4712-9450-4d8e88246360 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:18:41 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8bb8a186-042f-4712-9450-4d8e88246360 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:41 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8bb8a186-042f-4712-9450-4d8e88246360 1073741824 Aug 26 16:18:41 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:41 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.705s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:18:41 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Deleted volume successfully. Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e7a8ee76-d1df-42ef-8f2e-b1fc6a25786f tempest-AttachVolumeShelveTestJSON-506015742 None] Lock "cinder-3c96ce28-40ba-414f-960d-a14e3a4f7222-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:18:41 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8bb8a186-042f-4712-9450-4d8e88246360 1073741824" returned: 0 in 0.742s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8bb8a186-042f-4712-9450-4d8e88246360 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:41 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8bb8a186-042f-4712-9450-4d8e88246360 Aug 26 16:18:41 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:42 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8bb8a186-042f-4712-9450-4d8e88246360" returned: 0 in 0.405s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:18:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:18:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfd9906-8584-436a-a488-7739f32ee201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb8a186-042f-4712-9450-4d8e88246360', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb4899d-f00b-4fc6-bb46-c6a5abd8d33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:42 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Volume volume-8bb8a186-042f-4712-9450-4d8e88246360 (8bb8a186-042f-4712-9450-4d8e88246360): created successfully Aug 26 16:18:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb4899d-f00b-4fc6-bb46-c6a5abd8d33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Flow 'volume_create_manager' (242ebcaf-edc8-48ff-9ca3-c44348db5168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:18:42 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f13ade1a-c257-458e-bfbd-dce2b4d5e401 tempest-VolumeQuotasAdminTestJSON-824575377 None] Created volume successfully. Aug 26 16:18:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Acquiring lock "cinder-8bb8a186-042f-4712-9450-4d8e88246360-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:18:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "cinder-8bb8a186-042f-4712-9450-4d8e88246360-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:18:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Acquiring lock "cinder-quobyte-8bb8a186-042f-4712-9450-4d8e88246360" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:18:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "cinder-quobyte-8bb8a186-042f-4712-9450-4d8e88246360" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:18:43 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c94be7-44dc-47de-ba4b-6192c4a22d68]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:18:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8bb8a186-042f-4712-9450-4d8e88246360 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:43 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8bb8a186-042f-4712-9450-4d8e88246360 Aug 26 16:18:43 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:43 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8bb8a186-042f-4712-9450-4d8e88246360" returned: 0 in 0.484s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8bb8a186-042f-4712-9450-4d8e88246360 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:43 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8bb8a186-042f-4712-9450-4d8e88246360 Aug 26 16:18:43 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:44 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8bb8a186-042f-4712-9450-4d8e88246360" returned: 0 in 0.405s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "cinder-quobyte-8bb8a186-042f-4712-9450-4d8e88246360" released by "delete_volume" :: held 0.953s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:18:44 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Created reservations ['78b32154-8899-4a23-9130-e98dfb2fa355', '3f5f1657-b40f-449b-8fd1-559ca8fcff19', '76cbc4bc-0edc-48e0-b10a-4e5642e7a97c', '9bc6c0bd-7e9f-457f-92b2-94a8c21aa065'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:18:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:18:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:18:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:18:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:18:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:18:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:44 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:18:44 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:44 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.487s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:44 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:18:44 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Deleted volume successfully. Aug 26 16:18:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8fc7a2ef-2242-4d05-adc7-06ef65b45283 tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "cinder-8bb8a186-042f-4712-9450-4d8e88246360-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Flow 'volume_create_manager' (64699491-d00f-4b45-bc78-d471c31920bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabaecda-b89d-4ded-89f7-d4eb873a3428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabaecda-b89d-4ded-89f7-d4eb873a3428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-392667878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bdae18-9b59-42a7-9fa2-d0c22678f0c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253d63b900124dc0984e62afd3b295b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:18:46Z,use_quota=True,user_id='235ca92f96a84ac0a5013d1f9a8bcbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cdc77b-0443-406f-9662-4b2b40f53e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cdc77b-0443-406f-9662-4b2b40f53e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e99c27-2931-4f5c-b0d5-a63fabc40c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e99c27-2931-4f5c-b0d5-a63fabc40c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94bdae18-9b59-42a7-9fa2-d0c22678f0c1', 'volume_name': 'volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80148394-56b6-4096-936c-2dd467bde880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80148394-56b6-4096-936c-2dd467bde880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2beeb82f-d486-4787-a089-7c85ba5ad56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:46 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Volume 94bdae18-9b59-42a7-9fa2-d0c22678f0c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1', 'volume_size': 1} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-392667878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bdae18-9b59-42a7-9fa2-d0c22678f0c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253d63b900124dc0984e62afd3b295b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:18:46Z,use_quota=True,user_id='235ca92f96a84ac0a5013d1f9a8bcbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Creating volume 94bdae18-9b59-42a7-9fa2-d0c22678f0c1 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:18:46 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:18:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:46 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1 1073741824 Aug 26 16:18:46 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:47 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1 1073741824" returned: 0 in 0.786s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:47 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1 Aug 26 16:18:47 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:47 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1" returned: 0 in 0.385s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:18:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:18:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2beeb82f-d486-4787-a089-7c85ba5ad56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72930ba-86a8-40ea-9572-6d8fdeac09a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:18:48 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Volume volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1 (94bdae18-9b59-42a7-9fa2-d0c22678f0c1): created successfully Aug 26 16:18:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72930ba-86a8-40ea-9572-6d8fdeac09a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:18:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Flow 'volume_create_manager' (64699491-d00f-4b45-bc78-d471c31920bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:18:48 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c7cb04e7-d6cc-4416-96ea-bbb590226c7d tempest-VolumeQuotasAdminTestJSON-824575377 None] Created volume successfully. Aug 26 16:18:49 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bbeb56c5-ae03-40bd-994c-433c170daaaa tempest-VolumeQuotasAdminTestJSON-1429080403 None] Transfer volume completed successfully. Aug 26 16:18:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Acquiring lock "cinder-94bdae18-9b59-42a7-9fa2-d0c22678f0c1-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:18:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Lock "cinder-94bdae18-9b59-42a7-9fa2-d0c22678f0c1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:18:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Acquiring lock "cinder-quobyte-94bdae18-9b59-42a7-9fa2-d0c22678f0c1" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:18:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Lock "cinder-quobyte-94bdae18-9b59-42a7-9fa2-d0c22678f0c1" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:18:50 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9abc16-9888-4edd-92ae-622ce52037bb]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:18:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:50 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1 Aug 26 16:18:50 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:50 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1" returned: 0 in 0.462s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:50 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1 Aug 26 16:18:50 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:51 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-94bdae18-9b59-42a7-9fa2-d0c22678f0c1" returned: 0 in 0.365s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Lock "cinder-quobyte-94bdae18-9b59-42a7-9fa2-d0c22678f0c1" released by "delete_volume" :: held 0.919s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:18:51 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Created reservations ['a7ec0080-b842-4725-9ec6-ffa582776e12', '0b384077-6f2a-4f78-88e0-4dc868b39b54', '55c347f2-7f04-435d-a128-ea5f64b332b1', 'e2260716-547b-407e-a9f6-57da3f9eebf0'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:18:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:18:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:18:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:18:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:18:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:18:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:18:51 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:18:51 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:18:51 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Aug 26 16:18:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.284s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:18:51 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:18:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Deleted volume successfully. Aug 26 16:18:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ad258fd7-89e1-4e69-bf59-9573bea358ce tempest-VolumeQuotasAdminTestJSON-1909905114 None] Lock "cinder-94bdae18-9b59-42a7-9fa2-d0c22678f0c1-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:00 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-83593b2f-e704-4bab-b9c2-3a7b9cee6802 tempest-GroupSnapshotsTest-1937328690 None] Group tempest-GroupSnapshotsTest-Group-6403065: creating Aug 26 16:19:00 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-83593b2f-e704-4bab-b9c2-3a7b9cee6802 tempest-GroupSnapshotsTest-1937328690 None] Group tempest-GroupSnapshotsTest-Group-6403065: created successfully Aug 26 16:19:00 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-83593b2f-e704-4bab-b9c2-3a7b9cee6802 tempest-GroupSnapshotsTest-1937328690 None] Create group completed successfully. Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Flow 'volume_create_manager' (e317f93d-4a11-48ae-8229-d2b9f2a4cfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53238992-3e24-49cb-b875-74c502dd45bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53238992-3e24-49cb-b875-74c502dd45bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-868816698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca764385-21bf-41b8-b4f8-8387b14271aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bfcc12896e4aa4ac89644635572619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:02Z,use_quota=True,user_id='14b14cc0e709467f8966b109d01b7168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caec83b8-fe2f-4292-9519-654c39b0ad43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caec83b8-fe2f-4292-9519-654c39b0ad43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6911ad6-cd02-4325-adf0-3e30403ff96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6911ad6-cd02-4325-adf0-3e30403ff96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca764385-21bf-41b8-b4f8-8387b14271aa', 'volume_name': 'volume-ca764385-21bf-41b8-b4f8-8387b14271aa', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c415883-fdaf-4466-9403-dc35761cd795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c415883-fdaf-4466-9403-dc35761cd795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2730866-19ca-4ad3-8bbe-c84516e41362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:02 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Volume ca764385-21bf-41b8-b4f8-8387b14271aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca764385-21bf-41b8-b4f8-8387b14271aa', 'volume_size': 1} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-868816698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca764385-21bf-41b8-b4f8-8387b14271aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bfcc12896e4aa4ac89644635572619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:02Z,use_quota=True,user_id='14b14cc0e709467f8966b109d01b7168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Creating volume ca764385-21bf-41b8-b4f8-8387b14271aa {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:02 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca764385-21bf-41b8-b4f8-8387b14271aa 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:02 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca764385-21bf-41b8-b4f8-8387b14271aa 1073741824 Aug 26 16:19:02 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Flow 'volume_create_manager' (bb2f2bfc-e83c-4705-b4e8-96b70f31e81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92f5e5a-ffd8-4b42-ad07-305cada9d51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92f5e5a-ffd8-4b42-ad07-305cada9d51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1074627031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56f402bf-258d-466a-bbc5-af3c44598b8f,host='devstack@QuobyteHD#QuobyteHD',id=f5654397-6242-4724-ad67-cd9d9a75b0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f439953608394212af08324a451b0d08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:03Z,use_quota=True,user_id='f74662b93bec404b9af0e795fbd9f26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d8f0488-7490-4034-aead-45d2143d6226),volume_type_id=8d8f0488-7490-4034-aead-45d2143d6226)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba95ca41-ae9c-4f41-a281-933dfcb5c6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba95ca41-ae9c-4f41-a281-933dfcb5c6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c61851-85e8-4e43-93be-93b4bdd3c05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c61851-85e8-4e43-93be-93b4bdd3c05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5654397-6242-4724-ad67-cd9d9a75b0c4', 'volume_name': 'volume-f5654397-6242-4724-ad67-cd9d9a75b0c4', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d0b81e-bd27-4dd8-9b05-ecfde044d046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d0b81e-bd27-4dd8-9b05-ecfde044d046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb6b6ea-561e-42a5-98c7-4271b98d7dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:02 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Volume f5654397-6242-4724-ad67-cd9d9a75b0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5654397-6242-4724-ad67-cd9d9a75b0c4', 'volume_size': 1} Aug 26 16:19:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Flow 'volume_create_manager' (bdae58e5-9785-44ab-a211-50569cfdbb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f6672a-b664-4809-adfc-f641fb709d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f6672a-b664-4809-adfc-f641fb709d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1358382304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0c31fd-caad-42d9-8486-8b214790310b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f7b9a44e6248e2abc3d8b89271d3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:03Z,use_quota=True,user_id='d52714f65e4248a0805e74a22f6bc6bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217c6ba8-f300-4ce4-9615-41e2269c8009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217c6ba8-f300-4ce4-9615-41e2269c8009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895689bd-6ad1-4662-a943-8c87308f8999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895689bd-6ad1-4662-a943-8c87308f8999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d0c31fd-caad-42d9-8486-8b214790310b', 'volume_name': 'volume-7d0c31fd-caad-42d9-8486-8b214790310b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea07b7c0-f535-41a0-a8c1-739dfe1dc923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea07b7c0-f535-41a0-a8c1-739dfe1dc923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eef3393-cc15-44d5-99be-2d335c18faeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:03 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Volume 7d0c31fd-caad-42d9-8486-8b214790310b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d0c31fd-caad-42d9-8486-8b214790310b', 'volume_size': 1} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:03 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca764385-21bf-41b8-b4f8-8387b14271aa 1073741824" returned: 0 in 0.912s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca764385-21bf-41b8-b4f8-8387b14271aa {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:03 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca764385-21bf-41b8-b4f8-8387b14271aa Aug 26 16:19:03 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:03 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca764385-21bf-41b8-b4f8-8387b14271aa" returned: 0 in 0.256s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.707s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56f402bf-258d-466a-bbc5-af3c44598b8f,created_at=2026-08-26T14:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1074627031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56f402bf-258d-466a-bbc5-af3c44598b8f,host='devstack@QuobyteHD#QuobyteHD',id=f5654397-6242-4724-ad67-cd9d9a75b0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f439953608394212af08324a451b0d08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:03Z,use_quota=True,user_id='f74662b93bec404b9af0e795fbd9f26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d8f0488-7490-4034-aead-45d2143d6226),volume_type_id=8d8f0488-7490-4034-aead-45d2143d6226)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Creating volume f5654397-6242-4724-ad67-cd9d9a75b0c4 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:03 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:03 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 1073741824 Aug 26 16:19:03 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2730866-19ca-4ad3-8bbe-c84516e41362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca764385-21bf-41b8-b4f8-8387b14271aa', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871d79d6-0c21-4446-830c-623443cfe76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:03 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Volume volume-ca764385-21bf-41b8-b4f8-8387b14271aa (ca764385-21bf-41b8-b4f8-8387b14271aa): created successfully Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871d79d6-0c21-4446-830c-623443cfe76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Flow 'volume_create_manager' (e317f93d-4a11-48ae-8229-d2b9f2a4cfab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:03 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-d3c86100-de3a-49ef-a67d-7ca19ab009c5 tempest-AttachVolumeNegativeTest-1059842712 None] Created volume successfully. Aug 26 16:19:04 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 1073741824" returned: 0 in 0.559s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:04 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 Aug 26 16:19:04 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:04 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4" returned: 0 in 0.324s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.289s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1358382304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0c31fd-caad-42d9-8486-8b214790310b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f7b9a44e6248e2abc3d8b89271d3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:03Z,use_quota=True,user_id='d52714f65e4248a0805e74a22f6bc6bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Creating volume 7d0c31fd-caad-42d9-8486-8b214790310b {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:04 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d0c31fd-caad-42d9-8486-8b214790310b 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb6b6ea-561e-42a5-98c7-4271b98d7dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5654397-6242-4724-ad67-cd9d9a75b0c4', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28d3bc3-de72-409e-a24b-6437e7cfd860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:04 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d0c31fd-caad-42d9-8486-8b214790310b 1073741824 Aug 26 16:19:04 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:04 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Volume volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 (f5654397-6242-4724-ad67-cd9d9a75b0c4): created successfully Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28d3bc3-de72-409e-a24b-6437e7cfd860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Flow 'volume_create_manager' (bb2f2bfc-e83c-4705-b4e8-96b70f31e81d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:04 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-18a5f0f7-eade-4a83-bbb0-eeaeca260f93 tempest-GroupSnapshotsTest-1937328690 None] Created volume successfully. Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Flow 'volume_create_manager' (0cabbc91-ea43-4607-ad67-38a84c31daba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7dd301-74cb-45b3-bb10-ec0db41e2f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7dd301-74cb-45b3-bb10-ec0db41e2f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-840993886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bcffff-aea5-47ce-b12e-24e96bce2177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d610b1cbf3d42faa0099f1f7fd199d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:05Z,use_quota=True,user_id='ffa98fe7f1314f94a7f1784b0b06e6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(772b7fa3-8714-46b5-912a-582ccb66a9fa),volume_type_id=772b7fa3-8714-46b5-912a-582ccb66a9fa)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed45925-8da6-447c-9b7b-77175f631295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed45925-8da6-447c-9b7b-77175f631295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09dab90d-4fdd-4509-890c-525623c87824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09dab90d-4fdd-4509-890c-525623c87824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8bcffff-aea5-47ce-b12e-24e96bce2177', 'volume_name': 'volume-f8bcffff-aea5-47ce-b12e-24e96bce2177', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ff3f0a-ac7a-4172-90b4-ce3f4c0e0846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ff3f0a-ac7a-4172-90b4-ce3f4c0e0846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032b33bf-7191-413c-aee1-09a3fe5ed50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:05 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Volume f8bcffff-aea5-47ce-b12e-24e96bce2177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8bcffff-aea5-47ce-b12e-24e96bce2177', 'volume_size': 1} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:05 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d0c31fd-caad-42d9-8486-8b214790310b 1073741824" returned: 0 in 0.708s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d0c31fd-caad-42d9-8486-8b214790310b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:05 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d0c31fd-caad-42d9-8486-8b214790310b Aug 26 16:19:05 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-759d1f1a-4398-49dd-8f1c-79b9dc198a4b req-113cacb9-57b8-4b7c-97fe-8b6564540648 tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:05 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] GroupSnapshot b87891a5-14bc-4c44-9b77-f435faa7e384: creating. Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] Group snapshot b87891a5-14bc-4c44-9b77-f435faa7e384: creating. {{(pid=94407) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:05 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d0c31fd-caad-42d9-8486-8b214790310b" returned: 0 in 0.310s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.555s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-840993886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bcffff-aea5-47ce-b12e-24e96bce2177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d610b1cbf3d42faa0099f1f7fd199d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:05Z,use_quota=True,user_id='ffa98fe7f1314f94a7f1784b0b06e6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(772b7fa3-8714-46b5-912a-582ccb66a9fa),volume_type_id=772b7fa3-8714-46b5-912a-582ccb66a9fa)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Creating volume f8bcffff-aea5-47ce-b12e-24e96bce2177 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:05 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f8bcffff-aea5-47ce-b12e-24e96bce2177 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:05 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f8bcffff-aea5-47ce-b12e-24e96bce2177 1073741824 Aug 26 16:19:05 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eef3393-cc15-44d5-99be-2d335c18faeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d0c31fd-caad-42d9-8486-8b214790310b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1acbc9c-acef-4031-a0ea-cf1f92aeedbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:05 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Volume volume-7d0c31fd-caad-42d9-8486-8b214790310b (7d0c31fd-caad-42d9-8486-8b214790310b): created successfully Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1acbc9c-acef-4031-a0ea-cf1f92aeedbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Flow 'volume_create_manager' (bdae58e5-9785-44ab-a211-50569cfdbb85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:05 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-23edb510-20f8-4f58-ba6f-929c8dc023d9 tempest-TestMinimumBasicScenario-341467877 None] Created volume successfully. Aug 26 16:19:06 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f8bcffff-aea5-47ce-b12e-24e96bce2177 1073741824" returned: 0 in 0.422s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f8bcffff-aea5-47ce-b12e-24e96bce2177 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:06 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f8bcffff-aea5-47ce-b12e-24e96bce2177 Aug 26 16:19:06 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:06 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f8bcffff-aea5-47ce-b12e-24e96bce2177" returned: 0 in 0.261s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-759d1f1a-4398-49dd-8f1c-79b9dc198a4b req-113cacb9-57b8-4b7c-97fe-8b6564540648 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.896s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032b33bf-7191-413c-aee1-09a3fe5ed50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8bcffff-aea5-47ce-b12e-24e96bce2177', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4853974c-fd68-4a58-a9a2-efb10b7652a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-759d1f1a-4398-49dd-8f1c-79b9dc198a4b req-113cacb9-57b8-4b7c-97fe-8b6564540648 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.821s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:06 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Volume volume-f8bcffff-aea5-47ce-b12e-24e96bce2177 (f8bcffff-aea5-47ce-b12e-24e96bce2177): created successfully Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4853974c-fd68-4a58-a9a2-efb10b7652a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Flow 'volume_create_manager' (0cabbc91-ea43-4607-ad67-38a84c31daba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] Creating offline snapshot 43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 of volume f5654397-6242-4724-ad67-cd9d9a75b0c4 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:19:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8409f1fd-d118-4ef5-b972-5ebe9c3c4822 tempest-VolumeTypesAccessTest-2029999249 None] Created volume successfully. Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dae1876-8ea2-4a6b-b275-9a175126814d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-759d1f1a-4398-49dd-8f1c-79b9dc198a4b req-113cacb9-57b8-4b7c-97fe-8b6564540648 tempest-AttachVolumeNegativeTest-1059842712 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-ca764385-21bf-41b8-b4f8-8387b14271aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '735e9202-8ea5-4b0d-8514-a4a1c9130f0e', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:19:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-759d1f1a-4398-49dd-8f1c-79b9dc198a4b req-113cacb9-57b8-4b7c-97fe-8b6564540648 tempest-AttachVolumeNegativeTest-1059842712 None] attachment_update completed successfully. Aug 26 16:19:06 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 Aug 26 16:19:06 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:07 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4" returned: 0 in 0.646s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Acquiring lock "cinder-f8bcffff-aea5-47ce-b12e-24e96bce2177-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:07 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 1G Aug 26 16:19:07 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Lock "cinder-f8bcffff-aea5-47ce-b12e-24e96bce2177-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Acquiring lock "cinder-quobyte-f8bcffff-aea5-47ce-b12e-24e96bce2177" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Lock "cinder-quobyte-f8bcffff-aea5-47ce-b12e-24e96bce2177" acquired by "delete_volume" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:07 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20a5168-27a8-4411-abeb-6c9932bee185]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f8bcffff-aea5-47ce-b12e-24e96bce2177 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:07 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f8bcffff-aea5-47ce-b12e-24e96bce2177 Aug 26 16:19:07 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:08 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 1G" returned: 0 in 0.910s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:08 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 Aug 26 16:19:08 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:08 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f8bcffff-aea5-47ce-b12e-24e96bce2177" returned: 0 in 0.710s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f8bcffff-aea5-47ce-b12e-24e96bce2177 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-487451f7-327c-4688-9081-beff5f9efb0c req-1ec76c77-fe39-4cc5-a6d5-9a888fa8afde tempest-TestMinimumBasicScenario-341467877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:08 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f8bcffff-aea5-47ce-b12e-24e96bce2177 Aug 26 16:19:08 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:08 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0" returned: 0 in 0.388s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:08 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:08 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f8bcffff-aea5-47ce-b12e-24e96bce2177" returned: 0 in 0.302s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:08 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 Aug 26 16:19:08 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Lock "cinder-quobyte-f8bcffff-aea5-47ce-b12e-24e96bce2177" released by "delete_volume" :: held 1.099s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:08 devstack cinder-volume[94407]: WARNING cinder.quota [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2040826689 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2040826689, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:19:08 devstack cinder-volume[94407]: WARNING cinder.quota [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2040826689 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2040826689, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Created reservations ['eba44f87-57b3-4bf4-aaf8-1e7f286bc385', '6c25a83e-a150-434b-8e07-d270a3050092', '36a55b48-03c3-4f4e-8cb6-2adfa83e816a', '4ba3809f-4e09-41f8-853b-66924480e292'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:08 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:19:08 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:08 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0" returned: 0 in 0.352s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:08 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.info Aug 26 16:19:08 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:08 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.385s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:09 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:19:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Deleted volume successfully. Aug 26 16:19:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-302e25ff-6d76-4091-8de4-148b8e74cbb1 tempest-VolumeTypesAccessTest-2029999249 None] Lock "cinder-f8bcffff-aea5-47ce-b12e-24e96bce2177-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:09 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.info" returned: 0 in 0.405s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:09 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:19:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:09 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.info Aug 26 16:19:09 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:09 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.info" returned: 0 in 0.289s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.131s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-487451f7-327c-4688-9081-beff5f9efb0c req-1ec76c77-fe39-4cc5-a6d5-9a888fa8afde tempest-TestMinimumBasicScenario-341467877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.370s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-487451f7-327c-4688-9081-beff5f9efb0c req-1ec76c77-fe39-4cc5-a6d5-9a888fa8afde tempest-TestMinimumBasicScenario-341467877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-487451f7-327c-4688-9081-beff5f9efb0c req-1ec76c77-fe39-4cc5-a6d5-9a888fa8afde tempest-TestMinimumBasicScenario-341467877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-7d0c31fd-caad-42d9-8486-8b214790310b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '285396ec-1508-4d6e-a404-f0f043b144d7', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:19:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f4437c19-7c6c-44a1-9891-306f58a8c62d tempest-GroupSnapshotsTest-1937328690 None] group_snapshot b87891a5-14bc-4c44-9b77-f435faa7e384: created successfully Aug 26 16:19:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-487451f7-327c-4688-9081-beff5f9efb0c req-1ec76c77-fe39-4cc5-a6d5-9a888fa8afde tempest-TestMinimumBasicScenario-341467877 None] attachment_update completed successfully. Aug 26 16:19:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-bc782201-1b9d-4145-b6d5-d8f905ed52ca req-dab6dbe1-43ff-455f-aa8f-e68ae03c445e tempest-AttachVolumeNegativeTest-1059842712 None] Terminate volume connection completed successfully. Aug 26 16:19:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-bc782201-1b9d-4145-b6d5-d8f905ed52ca req-dab6dbe1-43ff-455f-aa8f-e68ae03c445e tempest-AttachVolumeNegativeTest-1059842712 None] Deleting attachment 735e9202-8ea5-4b0d-8514-a4a1c9130f0e. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-43cf05fd-75dc-409e-ac48-40e9bdb3ccf0-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c" by "_create_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-43cf05fd-75dc-409e-ac48-40e9bdb3ccf0-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Creating volume fef6c87e-6bc9-4b18-ab40-8b98b3cc296c from snapshot 43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 {{(pid=94407) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c" by "_copy_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c" acquired by "_copy_volume_from_snapshot" :: waited 0.086s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] snapshot: 43cf05fd-75dc-409e-ac48-40e9bdb3ccf0, volume: fef6c87e-6bc9-4b18-ab40-8b98b3cc296c, {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2021e483-cdf1-4692-a6dc-fc0895107a1e]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:12 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 Aug 26 16:19:12 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:12 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0" returned: 0 in 0.812s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5654397-6242-4724-ad67-cd9d9a75b0c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:19:12 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e6dffd-760b-4153-b8c4-ddb83fde7b4d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:12 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 Aug 26 16:19:12 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:13 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4" returned: 0 in 0.687s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] will copy from snapshot at /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 16:19:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Creating direct copy from snapshot {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 16:19:13 devstack cinder-volume[94407]: DEBUG cinder.utils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Path /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c not found in is_blk_device check {{(pid=94407) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 16:19:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:13 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c Aug 26 16:19:13 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:19:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:18 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:19:18 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:18 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.700s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:19:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:19:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 28 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:19:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:19:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "cinder-ca764385-21bf-41b8-b4f8-8387b14271aa-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Lock "cinder-ca764385-21bf-41b8-b4f8-8387b14271aa-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:19 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c" returned: 0 in 6.573s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:19 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:19:19 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Converted 1024.00 MB image at 155.72 MB/s Aug 26 16:19:19 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:19:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:20 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c Aug 26 16:19:20 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "cinder-quobyte-ca764385-21bf-41b8-b4f8-8387b14271aa" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Lock "cinder-quobyte-ca764385-21bf-41b8-b4f8-8387b14271aa" acquired by "delete_volume" :: waited 0.043s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:20 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bbed9b-2095-4cfc-b775-474c1e3001c8]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca764385-21bf-41b8-b4f8-8387b14271aa {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:20 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca764385-21bf-41b8-b4f8-8387b14271aa Aug 26 16:19:20 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:20 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c" returned: 0 in 0.431s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c" released by "_copy_volume_from_snapshot" :: held 8.727s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-43cf05fd-75dc-409e-ac48-40e9bdb3ccf0-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c" released by "_create_volume_from_snapshot" :: held 8.917s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.976s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:20 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b2c54ab0-878d-4591-b7ae-cb3436a2b1eb tempest-GroupSnapshotsTest-1937328690 None] Create group from source-snapshot-b87891a5-14bc-4c44-9b77-f435faa7e384 completed successfully. Aug 26 16:19:20 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca764385-21bf-41b8-b4f8-8387b14271aa" returned: 0 in 0.734s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca764385-21bf-41b8-b4f8-8387b14271aa {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:20 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca764385-21bf-41b8-b4f8-8387b14271aa Aug 26 16:19:20 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:21 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca764385-21bf-41b8-b4f8-8387b14271aa" returned: 0 in 0.416s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Lock "cinder-quobyte-ca764385-21bf-41b8-b4f8-8387b14271aa" released by "delete_volume" :: held 1.265s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:21 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Created reservations ['ad317cb1-377f-45ce-8e04-ef7631bac68d', '2d38cf96-ecaa-4c20-9180-38d87d276026', '889911f4-29f7-4945-bca8-e572753f3e78', 'f2322831-d91b-4228-9957-67afa22b34e8'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:21 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:19:21 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:22 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.674s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:22 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:19:22 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Deleted volume successfully. Aug 26 16:19:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c" acquired by "delete_volume" :: waited 0.071s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-22f08ee8-79c8-414d-9f7b-61732588fbbd tempest-AttachVolumeNegativeTest-1059842712 None] Lock "cinder-ca764385-21bf-41b8-b4f8-8387b14271aa-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "cinder-ed832d6a-6983-42f9-baa8-ea24b0daccb1-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:22 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0258ea-315b-485c-b08b-3cd6ca8a1220]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Lock "cinder-ed832d6a-6983-42f9-baa8-ea24b0daccb1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "cinder-quobyte-ed832d6a-6983-42f9-baa8-ea24b0daccb1" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Lock "cinder-quobyte-ed832d6a-6983-42f9-baa8-ea24b0daccb1" acquired by "delete_volume" :: waited 0.037s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:22 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bcb613-db37-4961-a854-f1c16a520cee]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:22 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c Aug 26 16:19:22 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:22 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1 Aug 26 16:19:22 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:23 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c" returned: 0 in 0.633s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:23 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c Aug 26 16:19:23 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:23 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1" returned: 0 in 0.586s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:23 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1 Aug 26 16:19:23 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:23 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ed832d6a-6983-42f9-baa8-ea24b0daccb1" returned: 0 in 0.338s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Lock "cinder-quobyte-ed832d6a-6983-42f9-baa8-ea24b0daccb1" released by "delete_volume" :: held 1.006s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:23 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c" returned: 0 in 0.543s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-fef6c87e-6bc9-4b18-ab40-8b98b3cc296c" released by "delete_volume" :: held 1.269s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Created reservations ['b1f55663-3c89-4bdc-8dc8-749df780c958', '13f320a6-819a-4d80-be93-16ffd830fe3c', '89429229-a0c8-4c56-b93e-344c193fb3bb', '95765921-11b7-424e-ba3c-ca28c46948f2'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Created reservations ['3fb2b3e9-cafe-4716-a718-428420ec9256'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:23 devstack cinder-volume[94407]: WARNING cinder.quota [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-780529296 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-780529296, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:19:23 devstack cinder-volume[94407]: WARNING cinder.quota [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-780529296 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-780529296, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:23 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:19:23 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:24 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Created reservations ['354050fe-53ae-4e96-b45c-58c0879253f8', 'b850bf16-cecb-4f55-b032-c799455880ac', 'd321a1a0-6cb7-4f7d-b0c1-875644ad8b1f', 'cd820082-73d1-470c-b539-016991241078'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:24 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:19:24 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:24 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.325s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:24 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:19:24 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Deleted volume successfully. Aug 26 16:19:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-adc1d898-5d56-4f39-a91f-53b6ac1f78cf tempest-AttachVolumeNegativeTest-1059842712 None] Lock "cinder-ed832d6a-6983-42f9-baa8-ea24b0daccb1-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:24 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.285s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:24 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:19:24 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-66dd1d69-bced-45e6-80c1-94bbe58cfbe1 tempest-GroupSnapshotsTest-1937328690 None] Delete group completed successfully. Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "cinder-22ad37ea-fc0a-4935-a70b-8714fd50d95e-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "cinder-22ad37ea-fc0a-4935-a70b-8714fd50d95e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "cinder-quobyte-22ad37ea-fc0a-4935-a70b-8714fd50d95e" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "cinder-quobyte-22ad37ea-fc0a-4935-a70b-8714fd50d95e" acquired by "delete_volume" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14d7f0c-95dd-43a3-9737-c2224b395691]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:25 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] group_snapshot b87891a5-14bc-4c44-9b77-f435faa7e384: deleting Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] group_snapshot b87891a5-14bc-4c44-9b77-f435faa7e384: deleting {{(pid=94407) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-f5654397-6242-4724-ad67-cd9d9a75b0c4" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-f5654397-6242-4724-ad67-cd9d9a75b0c4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-43cf05fd-75dc-409e-ac48-40e9bdb3ccf0" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-43cf05fd-75dc-409e-ac48-40e9bdb3ccf0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Deleting offline snapshot 43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 of volume f5654397-6242-4724-ad67-cd9d9a75b0c4 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] snapshot_file for this snap is: volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55a7c37-5662-4122-b690-bdc544f8a23c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:25 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e Aug 26 16:19:25 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:25 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 Aug 26 16:19:25 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:25 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e" returned: 0 in 0.622s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:25 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e Aug 26 16:19:25 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:26 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0" returned: 0 in 0.649s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5654397-6242-4724-ad67-cd9d9a75b0c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c63541-6751-4cac-93be-6bfc30291472]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:26 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22ad37ea-fc0a-4935-a70b-8714fd50d95e" returned: 0 in 0.369s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:26 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "cinder-quobyte-22ad37ea-fc0a-4935-a70b-8714fd50d95e" released by "delete_volume" :: held 1.066s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:26 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Created reservations ['6104a22b-e0fc-4de8-8fbb-a5b3e995913f', 'ea8c0ca0-8a03-4ff0-834f-a3a59c3d03ac', '31f7924a-93cb-40d5-857a-5b592f6c806c', '6ec164fc-fd97-4cbe-ae14-5ea1125a93d4'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:26 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:19:26 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:26 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.375s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:19:26 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Deleted volume successfully. Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-67f159cd-6e5c-419e-bf7d-54c5094b35f3 tempest-AttachVolumeNegativeTest-1059842712 None] Lock "cinder-22ad37ea-fc0a-4935-a70b-8714fd50d95e-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:26 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4" returned: 0 in 0.776s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:26 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 Aug 26 16:19:26 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:27 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0" returned: 0 in 0.418s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:27 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0 Aug 26 16:19:27 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:27 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4.43cf05fd-75dc-409e-ac48-40e9bdb3ccf0" returned: 0 in 0.283s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-43cf05fd-75dc-409e-ac48-40e9bdb3ccf0" released by "_delete_snapshot" :: held 2.248s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-f5654397-6242-4724-ad67-cd9d9a75b0c4" released by "delete_snapshot" :: held 2.283s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:27 devstack cinder-volume[94407]: WARNING cinder.quota [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-780529296 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-780529296, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:19:27 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] Created reservations ['55936acd-fb71-4d6a-a2e5-cc69b77983a3', '3a919155-faa2-49f9-bdcc-46ed5fb0039c', 'b36b8c12-2284-4d81-bd7c-559474a6cce1', 'c722db5a-8738-497c-a0c2-93f4657793cf'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:27 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5336dc16-495e-4dd9-b235-63656eb4c147 tempest-GroupSnapshotsTest-1937328690 None] group_snapshot b87891a5-14bc-4c44-9b77-f435faa7e384: deleted successfully Aug 26 16:19:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-f5654397-6242-4724-ad67-cd9d9a75b0c4" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-f5654397-6242-4724-ad67-cd9d9a75b0c4" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:28 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[6134e4df-1783-48ff-8d50-04931c75b365]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:28 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 Aug 26 16:19:28 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:28 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4" returned: 0 in 0.473s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:28 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4 Aug 26 16:19:28 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:28 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f5654397-6242-4724-ad67-cd9d9a75b0c4" returned: 0 in 0.274s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-f5654397-6242-4724-ad67-cd9d9a75b0c4" released by "delete_volume" :: held 0.822s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:29 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Created reservations ['bd537fcd-bdb9-4bd1-8b52-eb99e54ff944'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:29 devstack cinder-volume[94407]: WARNING cinder.db.api [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-780529296'] Aug 26 16:19:29 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Created reservations ['044051f1-cf82-4b11-b677-50719c1e84d9', '0e48f68d-0e21-4bbd-9d9f-aed00845220e', 'ed199139-cdcc-4b84-a2c4-d0e9edec2beb', '07f58ffc-a5de-405f-948b-4537d866d394'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:29 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:19:29 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:29 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.316s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:29 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:19:29 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9d54db1a-814b-4a56-8733-578a4b1bd0a4 tempest-GroupSnapshotsTest-1937328690 None] Delete group completed successfully. Aug 26 16:19:29 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-faa90346-7c6d-4075-8011-fc171e60948a tempest-GroupSnapshotsTest-1937328690 None] Group tempest-GroupSnapshotsTest-Group-872471888: creating Aug 26 16:19:29 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-faa90346-7c6d-4075-8011-fc171e60948a tempest-GroupSnapshotsTest-1937328690 None] Group tempest-GroupSnapshotsTest-Group-872471888: created successfully Aug 26 16:19:30 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-faa90346-7c6d-4075-8011-fc171e60948a tempest-GroupSnapshotsTest-1937328690 None] Create group completed successfully. Aug 26 16:19:30 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:19:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Flow 'volume_create_manager' (7ec1a2a5-7fb2-440c-a10c-535622dc2e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad31df0-325e-4866-b98f-57796de0c088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad31df0-325e-4866-b98f-57796de0c088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1824297812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10577720-58cb-439e-8991-38a9469e6e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a7ce6609ea4bdcae23c5b1b37c7ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:31Z,use_quota=True,user_id='28a16883cb4b43ea9d13384937c84508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bf805b-f340-48bb-a641-86057b1bd3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bf805b-f340-48bb-a641-86057b1bd3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd7b176-96a4-4bfa-b4ba-c8ab00a435b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:30 devstack cinder-volume[94407]: DEBUG cinder.image.glance [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Creating Keystone auth plugin from conf {{(pid=94407) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd7b176-96a4-4bfa-b4ba-c8ab00a435b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10577720-58cb-439e-8991-38a9469e6e88', 'volume_name': 'volume-10577720-58cb-439e-8991-38a9469e6e88', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45688288-834c-4e68-98a0-2b35084fe811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45688288-834c-4e68-98a0-2b35084fe811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21453b87-b445-4a58-9a9a-2d268f70312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:31 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Volume 10577720-58cb-439e-8991-38a9469e6e88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10577720-58cb-439e-8991-38a9469e6e88', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Trying to clone 10577720-58cb-439e-8991-38a9469e6e88 from image 6ac3a618-4ad2-4833-9626-12a425ebacfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]). {{(pid=94407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 16:19:31 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Image download 20.69 MB at 20.69 MB/s Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Flow 'volume_create_manager' (5c7ae075-7036-4394-bd00-105fa90b0be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6879770-5fa1-4724-90eb-9bc52956c1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6879770-5fa1-4724-90eb-9bc52956c1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-672030463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=047517fd-7bdd-4a7b-8921-5d11c2606bb0,host='devstack@QuobyteHD#QuobyteHD',id=010dd6ed-a548-4f15-bc19-349de95bf835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f439953608394212af08324a451b0d08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:32Z,use_quota=True,user_id='f74662b93bec404b9af0e795fbd9f26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(072a919d-4ffa-47da-977a-c2cc9b7d9122),volume_type_id=072a919d-4ffa-47da-977a-c2cc9b7d9122)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cb124f-4086-40cb-8437-952f36403ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cb124f-4086-40cb-8437-952f36403ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09fd79d-7d4b-4513-8360-93136c4aab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09fd79d-7d4b-4513-8360-93136c4aab29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010dd6ed-a548-4f15-bc19-349de95bf835', 'volume_name': 'volume-010dd6ed-a548-4f15-bc19-349de95bf835', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda427de-f41d-4b91-8361-6604ab0c1fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda427de-f41d-4b91-8361-6604ab0c1fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f591717f-5dbc-413f-a181-d31e16d7d4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:31 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Volume 010dd6ed-a548-4f15-bc19-349de95bf835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010dd6ed-a548-4f15-bc19-349de95bf835', 'volume_size': 1} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=047517fd-7bdd-4a7b-8921-5d11c2606bb0,created_at=2026-08-26T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-672030463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=047517fd-7bdd-4a7b-8921-5d11c2606bb0,host='devstack@QuobyteHD#QuobyteHD',id=010dd6ed-a548-4f15-bc19-349de95bf835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f439953608394212af08324a451b0d08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:32Z,use_quota=True,user_id='f74662b93bec404b9af0e795fbd9f26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(072a919d-4ffa-47da-977a-c2cc9b7d9122),volume_type_id=072a919d-4ffa-47da-977a-c2cc9b7d9122)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Creating volume 010dd6ed-a548-4f15-bc19-349de95bf835 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:31 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ece87f5-3bf8-40a4-aff9-71dc6763fe3e]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:31 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835 1073741824 Aug 26 16:19:31 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:32 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD Aug 26 16:19:32 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:32 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Temporary image 6ac3a618-4ad2-4833-9626-12a425ebacfd is fetched for user 28a16883cb4b43ea9d13384937c84508. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27279d7-c6af-438f-b617-47b0dca2f8ff]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:32 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835 1073741824" returned: 0 in 0.555s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:32 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD Aug 26 16:19:32 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:32 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835 Aug 26 16:19:32 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:32 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:32 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835" returned: 0 in 0.270s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1824297812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10577720-58cb-439e-8991-38a9469e6e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a7ce6609ea4bdcae23c5b1b37c7ca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:31Z,use_quota=True,user_id='28a16883cb4b43ea9d13384937c84508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Creating volume 10577720-58cb-439e-8991-38a9469e6e88 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:32 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:32 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 1073741824 Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f591717f-5dbc-413f-a181-d31e16d7d4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010dd6ed-a548-4f15-bc19-349de95bf835', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:32 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0026b4a-3d00-4e75-85ef-17c02c837a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:32 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Volume volume-010dd6ed-a548-4f15-bc19-349de95bf835 (010dd6ed-a548-4f15-bc19-349de95bf835): created successfully Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0026b4a-3d00-4e75-85ef-17c02c837a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Flow 'volume_create_manager' (5c7ae075-7036-4394-bd00-105fa90b0be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:32 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5a8a03a2-9399-40e5-9988-b48c8c085c75 tempest-GroupSnapshotsTest-1937328690 None] Created volume successfully. Aug 26 16:19:33 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 1073741824" returned: 0 in 0.568s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:33 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 Aug 26 16:19:33 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:33 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88" returned: 0 in 0.320s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Flow 'volume_create_manager' (f1d26f37-ef20-4eea-b18f-2447bd20f791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2767eee8-c77a-43ba-840d-5133d44e3266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Attempting download of 6ac3a618-4ad2-4833-9626-12a425ebacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}])) to volume 10577720-58cb-439e-8991-38a9469e6e88. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2767eee8-c77a-43ba-840d-5133d44e3266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1969193294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=047517fd-7bdd-4a7b-8921-5d11c2606bb0,host='devstack@QuobyteHD#QuobyteHD',id=24e0ff07-168a-43ff-b815-da164c812cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f439953608394212af08324a451b0d08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:34Z,use_quota=True,user_id='f74662b93bec404b9af0e795fbd9f26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(072a919d-4ffa-47da-977a-c2cc9b7d9122),volume_type_id=072a919d-4ffa-47da-977a-c2cc9b7d9122)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3054d092-0c77-4a7a-bef1-e727bca39624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3054d092-0c77-4a7a-bef1-e727bca39624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a72898-b6b2-467e-b297-bff9ec6b1988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a72898-b6b2-467e-b297-bff9ec6b1988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e0ff07-168a-43ff-b815-da164c812cf2', 'volume_name': 'volume-24e0ff07-168a-43ff-b815-da164c812cf2', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5965165d-c0be-45c8-adb8-bb8ba3abfe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5965165d-c0be-45c8-adb8-bb8ba3abfe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a240e271-b6c2-46ed-bc3c-0727f5024629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:33 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Volume 24e0ff07-168a-43ff-b815-da164c812cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e0ff07-168a-43ff-b815-da164c812cf2', 'volume_size': 1} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=047517fd-7bdd-4a7b-8921-5d11c2606bb0,created_at=2026-08-26T14:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1969193294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=047517fd-7bdd-4a7b-8921-5d11c2606bb0,host='devstack@QuobyteHD#QuobyteHD',id=24e0ff07-168a-43ff-b815-da164c812cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f439953608394212af08324a451b0d08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:34Z,use_quota=True,user_id='f74662b93bec404b9af0e795fbd9f26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(072a919d-4ffa-47da-977a-c2cc9b7d9122),volume_type_id=072a919d-4ffa-47da-977a-c2cc9b7d9122)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Creating volume 24e0ff07-168a-43ff-b815-da164c812cf2 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:33 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:33 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2 1073741824 Aug 26 16:19:33 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ccece3-ff9d-46f8-8d90-d6371203487c]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_z4xpgtbw {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:34 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_z4xpgtbw Aug 26 16:19:34 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:34 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_z4xpgtbw" returned: 0 in 0.380s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_z4xpgtbw {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:34 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2 1073741824" returned: 0 in 0.523s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:34 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_z4xpgtbw Aug 26 16:19:34 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:34 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2 Aug 26 16:19:34 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:34 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_z4xpgtbw" returned: 1 in 0.348s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_z4xpgtbw' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dbd37e-3a28-4134-91eb-964f3eb703e5]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:34 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2" returned: 0 in 0.278s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a240e271-b6c2-46ed-bc3c-0727f5024629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e0ff07-168a-43ff-b815-da164c812cf2', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9677e768-dcae-4db2-b832-ddbc5193a05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:34 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD Aug 26 16:19:34 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:34 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Volume volume-24e0ff07-168a-43ff-b815-da164c812cf2 (24e0ff07-168a-43ff-b815-da164c812cf2): created successfully Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9677e768-dcae-4db2-b832-ddbc5193a05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Flow 'volume_create_manager' (f1d26f37-ef20-4eea-b18f-2447bd20f791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:34 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-61736390-b081-42f8-befc-b4d681a47312 tempest-GroupSnapshotsTest-1937328690 None] Created volume successfully. Aug 26 16:19:34 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:34 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] 6ac3a618-4ad2-4833-9626-12a425ebacfd was qcow2, converting to qcow2 {{(pid=94407) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 16:19:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:35 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 Aug 26 16:19:35 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:35 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-4afc6e07-0443-43c6-a9e8-2e0f6cec0f97 tempest-GroupSnapshotsTest-1937328690 None] Update group completed successfully. Aug 26 16:19:36 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e1f1329b-cf2b-4c08-8de3-9691943375ec tempest-GroupSnapshotsTest-1937328690 None] Update group completed successfully. Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Flow 'volume_create_manager' (c587ad4f-9e6a-4871-8337-155080de1158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45898904-80c3-46df-a76b-a80eda7c1763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45898904-80c3-46df-a76b-a80eda7c1763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1774103354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287ae792-c449-44f6-8d5c-45a7763d2bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5e8befbf344aafae64f579ca55cd61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:36Z,use_quota=True,user_id='6ace4abc0ee24b7a83ea29bdb4140d37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5140b3-5b2f-481b-9997-ddff53bba034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5140b3-5b2f-481b-9997-ddff53bba034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4ce984-bfee-4675-89d1-50115e7f5cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4ce984-bfee-4675-89d1-50115e7f5cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287ae792-c449-44f6-8d5c-45a7763d2bca', 'volume_name': 'volume-287ae792-c449-44f6-8d5c-45a7763d2bca', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f9bcaf-869b-4515-9c62-1e10cdc69c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f9bcaf-869b-4515-9c62-1e10cdc69c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38ecc3e-dc2c-40aa-8563-9a72d8b49d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:36 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Volume 287ae792-c449-44f6-8d5c-45a7763d2bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287ae792-c449-44f6-8d5c-45a7763d2bca', 'volume_size': 1} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1774103354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287ae792-c449-44f6-8d5c-45a7763d2bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5e8befbf344aafae64f579ca55cd61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:36Z,use_quota=True,user_id='6ace4abc0ee24b7a83ea29bdb4140d37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Creating volume 287ae792-c449-44f6-8d5c-45a7763d2bca {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:36 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:36 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca 1073741824 Aug 26 16:19:36 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:36 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88" returned: 0 in 1.982s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_22fwmgzmdevstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:19:36 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Converted 112.00 MB image at 56.46 MB/s Aug 26 16:19:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:37 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 1G Aug 26 16:19:37 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:37 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca 1073741824" returned: 0 in 0.500s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=123,cinder:INSERT=27,cinder:UPDATE=111,cinder:DELETE=7 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=102,cinder:UPDATE=134,cinder:INSERT=27,cinder:DELETE=8 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:37 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca Aug 26 16:19:37 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:37 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 1G" returned: 0 in 0.351s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Downloaded image 6ac3a618-4ad2-4833-9626-12a425ebacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}])) to volume 10577720-58cb-439e-8991-38a9469e6e88 successfully. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Temporary image 6ac3a618-4ad2-4833-9626-12a425ebacfd for user 28a16883cb4b43ea9d13384937c84508 is deleted. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Marking volume 10577720-58cb-439e-8991-38a9469e6e88 as bootable. {{(pid=94407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Copying metadata from image 6ac3a618-4ad2-4833-9626-12a425ebacfd to 10577720-58cb-439e-8991-38a9469e6e88. {{(pid=94407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Creating volume glance metadata for volume 10577720-58cb-439e-8991-38a9469e6e88 backed by image 6ac3a618-4ad2-4833-9626-12a425ebacfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 16:19:37 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca" returned: 0 in 0.262s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38ecc3e-dc2c-40aa-8563-9a72d8b49d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287ae792-c449-44f6-8d5c-45a7763d2bca', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67af95fb-2949-4247-a1f9-2ee2c33e4214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:37 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Volume volume-287ae792-c449-44f6-8d5c-45a7763d2bca (287ae792-c449-44f6-8d5c-45a7763d2bca): created successfully Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67af95fb-2949-4247-a1f9-2ee2c33e4214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Flow 'volume_create_manager' (c587ad4f-9e6a-4871-8337-155080de1158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-4a653480-b1f8-48f0-8c88-d25f1744941a req-b8467145-3175-446a-b93f-ffa52617577c tempest-VolumesSnapshotsTestJSON-312623766 None] Created volume successfully. Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21453b87-b445-4a58-9a9a-2d268f70312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10577720-58cb-439e-8991-38a9469e6e88', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4b2bc8-994d-4084-839e-2381a365e22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:37 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Volume volume-10577720-58cb-439e-8991-38a9469e6e88 (10577720-58cb-439e-8991-38a9469e6e88): created successfully Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4b2bc8-994d-4084-839e-2381a365e22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Flow 'volume_create_manager' (7ec1a2a5-7fb2-440c-a10c-535622dc2e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-4fdc13b0-ac9f-45dd-ba13-caff6e7b3d1d tempest-VolumesImageMetadata-271779511 None] Created volume successfully. Aug 26 16:19:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0242f4d6-6f67-4fd6-a826-21a76cf85f77 tempest-GroupSnapshotsTest-1937328690 None] Update group completed successfully. Aug 26 16:19:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Acquiring lock "cinder-10577720-58cb-439e-8991-38a9469e6e88-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:38 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] Creating offline snapshot 2924d22b-8d3b-4905-ade2-b3653ef26d62 of volume 287ae792-c449-44f6-8d5c-45a7763d2bca {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:19:38 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-48fe98e8-58f7-4c42-9f49-d9b4be8f8ed0 tempest-GroupSnapshotsTest-1937328690 None] Update group completed successfully. Aug 26 16:19:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Lock "cinder-10577720-58cb-439e-8991-38a9469e6e88-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:38 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0fdfc1-0bbd-497e-ac04-2af68b3b21c8]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Acquiring lock "cinder-quobyte-10577720-58cb-439e-8991-38a9469e6e88" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Lock "cinder-quobyte-10577720-58cb-439e-8991-38a9469e6e88" acquired by "delete_volume" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4d5458-fe45-40cc-82eb-119fff091fd3]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:39 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca Aug 26 16:19:39 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:39 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 Aug 26 16:19:39 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:39 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca" returned: 0 in 0.421s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:39 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 1G Aug 26 16:19:39 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:39 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88" returned: 0 in 0.429s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:39 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88 Aug 26 16:19:39 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:39 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-10577720-58cb-439e-8991-38a9469e6e88" returned: 0 in 0.270s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Lock "cinder-quobyte-10577720-58cb-439e-8991-38a9469e6e88" released by "delete_volume" :: held 0.743s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Created reservations ['386d23c8-b75b-4ed9-a5c6-5d82af864b24', '1cb7cdd3-edb9-46b8-aa63-0ee921873397', '2d657111-64c5-40bf-955b-fc51e165da56', '08e0e3bf-697a-4bd8-b51a-4abd27c624b4'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:39 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 1G" returned: 0 in 0.470s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287ae792-c449-44f6-8d5c-45a7763d2bca -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:39 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287ae792-c449-44f6-8d5c-45a7763d2bca -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 Aug 26 16:19:39 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:39 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:19:39 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:40 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287ae792-c449-44f6-8d5c-45a7763d2bca -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62" returned: 0 in 0.393s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:40 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 is being set with open permissions: ugo+rw Aug 26 16:19:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:40 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.371s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:40 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:19:40 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 Aug 26 16:19:40 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:40 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Deleted volume successfully. Aug 26 16:19:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a6e0b997-f5e1-4d62-85b4-821aa1e4bfed tempest-VolumesImageMetadata-271779511 None] Lock "cinder-10577720-58cb-439e-8991-38a9469e6e88-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:40 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62" returned: 0 in 0.355s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:40 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] GroupSnapshot a5e50612-63c8-412a-bd89-673e07f4cbb0: creating. Aug 26 16:19:40 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.info Aug 26 16:19:40 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Group snapshot a5e50612-63c8-412a-bd89-673e07f4cbb0: creating. {{(pid=94407) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 16:19:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:40 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.info" returned: 0 in 0.306s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:40 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.info is being set with open permissions: ugo+rw Aug 26 16:19:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:40 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.info Aug 26 16:19:40 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:41 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.info" returned: 0 in 0.291s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.417s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.522s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Creating offline snapshot 7432d82e-0f51-439f-b5a3-4bbb439dd30e of volume 010dd6ed-a548-4f15-bc19-349de95bf835 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:19:41 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbadaeb-a03c-47eb-a4c2-8f8f88315b44]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:41 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-96c21006-d7b2-4247-b582-da0082f7f65f req-b2f914bd-6230-43a3-b959-e15e6e38ed63 tempest-VolumesSnapshotsTestJSON-312623766 None] Create snapshot completed successfully Aug 26 16:19:41 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835 Aug 26 16:19:41 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:41 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835" returned: 0 in 0.522s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:41 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e 1G Aug 26 16:19:41 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Acquiring lock "cinder-2924d22b-8d3b-4905-ade2-b3653ef26d62-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "cinder-2924d22b-8d3b-4905-ade2-b3653ef26d62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Acquiring lock "cinder-quobyte-287ae792-c449-44f6-8d5c-45a7763d2bca" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "cinder-quobyte-287ae792-c449-44f6-8d5c-45a7763d2bca" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Acquiring lock "cinder-quobyte-2924d22b-8d3b-4905-ade2-b3653ef26d62" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:42 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e 1G" returned: 0 in 0.648s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010dd6ed-a548-4f15-bc19-349de95bf835 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "cinder-quobyte-2924d22b-8d3b-4905-ade2-b3653ef26d62" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Deleting offline snapshot 2924d22b-8d3b-4905-ade2-b3653ef26d62 of volume 287ae792-c449-44f6-8d5c-45a7763d2bca {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:19:42 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010dd6ed-a548-4f15-bc19-349de95bf835 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e Aug 26 16:19:42 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] snapshot_file for this snap is: volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedd9e49-979f-4ee1-8e77-f476b86190cf]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:42 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 Aug 26 16:19:42 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:42 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010dd6ed-a548-4f15-bc19-349de95bf835 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e" returned: 0 in 0.417s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:42 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:19:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:42 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e Aug 26 16:19:42 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:43 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62" returned: 0 in 0.562s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:43 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-287ae792-c449-44f6-8d5c-45a7763d2bca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:19:43 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa0aa7d-1c24-46de-ad29-b12c11d0a204]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:43 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e" returned: 0 in 0.298s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:43 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.info Aug 26 16:19:43 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:43 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca Aug 26 16:19:43 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:43 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:43 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.info" returned: 0 in 0.421s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:43 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:19:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca" returned: 0 in 0.541s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:43 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.info Aug 26 16:19:43 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:43 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 Aug 26 16:19:43 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:43 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.info" returned: 0 in 0.290s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.728s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Creating offline snapshot afa1f148-a761-45b5-9b2e-711a984c70a1 of volume 24e0ff07-168a-43ff-b815-da164c812cf2 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f51826-ce9b-49e2-b512-92cd467fa7fd]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:44 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2 Aug 26 16:19:44 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:44 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62" returned: 0 in 0.511s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:44 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62 Aug 26 16:19:44 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:44 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:44 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca.2924d22b-8d3b-4905-ade2-b3653ef26d62" returned: 0 in 0.308s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2" returned: 0 in 0.488s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:44 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 1G Aug 26 16:19:44 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "cinder-quobyte-2924d22b-8d3b-4905-ade2-b3653ef26d62" released by "_delete_snapshot" :: held 2.090s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "cinder-quobyte-287ae792-c449-44f6-8d5c-45a7763d2bca" released by "delete_snapshot" :: held 2.156s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG cinder.quota [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Created reservations ['4e872f47-bfed-4601-a1f7-d18b34d95356', '28c7ab64-0704-40f6-8152-5b5e170342b0', 'b94e85c3-b58b-45b1-b2fb-9a099a4118ca', 'd45f8fa8-9f75-4284-8bc5-12974617558f'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:44 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Delete snapshot completed successfully. Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-e8610092-2380-42b9-823e-8be8aea21782 req-6c70ff55-8217-4477-8c03-1d31aee396f0 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "cinder-2924d22b-8d3b-4905-ade2-b3653ef26d62-delete_snapshot" released by "delete_snapshot" :: held 2.410s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Acquiring lock "cinder-287ae792-c449-44f6-8d5c-45a7763d2bca-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "cinder-287ae792-c449-44f6-8d5c-45a7763d2bca-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Acquiring lock "cinder-quobyte-287ae792-c449-44f6-8d5c-45a7763d2bca" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "cinder-quobyte-287ae792-c449-44f6-8d5c-45a7763d2bca" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2779623a-f6b0-4005-adb3-9fee6fad8a79]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:45 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 1G" returned: 0 in 0.728s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e0ff07-168a-43ff-b815-da164c812cf2 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:45 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca Aug 26 16:19:45 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:45 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e0ff07-168a-43ff-b815-da164c812cf2 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 Aug 26 16:19:45 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:45 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca" returned: 0 in 0.491s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:45 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e0ff07-168a-43ff-b815-da164c812cf2 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1" returned: 0 in 0.346s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:45 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:45 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca Aug 26 16:19:45 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:45 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 Aug 26 16:19:45 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:45 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1" returned: 0 in 0.267s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:45 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.info Aug 26 16:19:45 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:45 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-287ae792-c449-44f6-8d5c-45a7763d2bca" returned: 0 in 0.374s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "cinder-quobyte-287ae792-c449-44f6-8d5c-45a7763d2bca" released by "delete_volume" :: held 0.951s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG cinder.quota [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Created reservations ['a6c4f1cf-c96d-485e-8756-0dd5b1f37063', '71717d64-a71a-4504-9ae6-3e29a5fcb239', '74aa2cbe-a461-4664-a630-a9a1dd163605', '46a557d5-8bc2-4041-b20d-ff6788ee67d0'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:46 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:19:46 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:46 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.info" returned: 0 in 0.366s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:46 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:46 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.info Aug 26 16:19:46 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:46 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.308s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG cinder.manager [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:19:46 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Deleted volume successfully. Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-88a07dd2-1442-4800-8f9a-c709d7913193 req-a0aa9f83-8dfc-4cb0-86c3-1d6da0800a76 tempest-VolumesSnapshotsTestJSON-312623766 None] Lock "cinder-287ae792-c449-44f6-8d5c-45a7763d2bca-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:46 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.info" returned: 0 in 0.343s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.652s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:46 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6ec77dc1-af2a-4abd-8731-affa2a734f01 tempest-GroupSnapshotsTest-1937328690 None] group_snapshot a5e50612-63c8-412a-bd89-673e07f4cbb0: created successfully Aug 26 16:19:47 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] group_snapshot a5e50612-63c8-412a-bd89-673e07f4cbb0: deleting Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] group_snapshot a5e50612-63c8-412a-bd89-673e07f4cbb0: deleting {{(pid=94407) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-010dd6ed-a548-4f15-bc19-349de95bf835" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-010dd6ed-a548-4f15-bc19-349de95bf835" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-7432d82e-0f51-439f-b5a3-4bbb439dd30e" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-7432d82e-0f51-439f-b5a3-4bbb439dd30e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Deleting offline snapshot 7432d82e-0f51-439f-b5a3-4bbb439dd30e of volume 010dd6ed-a548-4f15-bc19-349de95bf835 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] snapshot_file for this snap is: volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[4208b535-e7ae-40ce-bb08-af363a80bd8a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Flow 'volume_create_manager' (70615c8f-8543-43bb-a3cd-0b675be5527b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa84292-cdff-4da6-9d51-b44701249be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:47 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa84292-cdff-4da6-9d51-b44701249be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1601522199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20bf8433-4427-4e78-8b91-5361bca98c63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4adc2f0daaf4bab9f18060ec9efc3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:48Z,use_quota=True,user_id='ee129218d8af47da8b27be3482a7b2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:47 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4b9e2e-b2a0-47bf-a241-24db533f6308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4b9e2e-b2a0-47bf-a241-24db533f6308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f44401e-c1cb-4f46-966b-3472332050ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f44401e-c1cb-4f46-966b-3472332050ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20bf8433-4427-4e78-8b91-5361bca98c63', 'volume_name': 'volume-20bf8433-4427-4e78-8b91-5361bca98c63', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c016c9f2-2a97-49af-814d-8c497e62e394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c016c9f2-2a97-49af-814d-8c497e62e394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f92e82-4301-4ac2-98cf-726201ab9a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:47 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Volume 20bf8433-4427-4e78-8b91-5361bca98c63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20bf8433-4427-4e78-8b91-5361bca98c63', 'volume_size': 1} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1601522199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20bf8433-4427-4e78-8b91-5361bca98c63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4adc2f0daaf4bab9f18060ec9efc3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:48Z,use_quota=True,user_id='ee129218d8af47da8b27be3482a7b2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Creating volume 20bf8433-4427-4e78-8b91-5361bca98c63 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:47 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:19:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20bf8433-4427-4e78-8b91-5361bca98c63 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:47 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20bf8433-4427-4e78-8b91-5361bca98c63 1073741824 Aug 26 16:19:47 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:48 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e" returned: 0 in 0.621s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-010dd6ed-a548-4f15-bc19-349de95bf835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b17c2d-32a0-459b-abe9-264b6a619b00]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:48 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835 Aug 26 16:19:48 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:48 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20bf8433-4427-4e78-8b91-5361bca98c63 1073741824" returned: 0 in 0.554s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20bf8433-4427-4e78-8b91-5361bca98c63 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:48 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20bf8433-4427-4e78-8b91-5361bca98c63 Aug 26 16:19:48 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:48 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835" returned: 0 in 0.585s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:48 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e Aug 26 16:19:48 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:48 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20bf8433-4427-4e78-8b91-5361bca98c63" returned: 0 in 0.406s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f92e82-4301-4ac2-98cf-726201ab9a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20bf8433-4427-4e78-8b91-5361bca98c63', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acd654a-fc8a-435c-8f79-91cf6cc0acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:48 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Volume volume-20bf8433-4427-4e78-8b91-5361bca98c63 (20bf8433-4427-4e78-8b91-5361bca98c63): created successfully Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acd654a-fc8a-435c-8f79-91cf6cc0acd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Flow 'volume_create_manager' (70615c8f-8543-43bb-a3cd-0b675be5527b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:49 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5f42b929-5d87-417e-93bd-012a98a63eac tempest-VolumesListTestJSON-737425006 None] Created volume successfully. Aug 26 16:19:49 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e" returned: 0 in 0.462s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:49 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e Aug 26 16:19:49 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:49 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835.7432d82e-0f51-439f-b5a3-4bbb439dd30e" returned: 0 in 0.258s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-7432d82e-0f51-439f-b5a3-4bbb439dd30e" released by "_delete_snapshot" :: held 2.065s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-010dd6ed-a548-4f15-bc19-349de95bf835" released by "delete_snapshot" :: held 2.101s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-24e0ff07-168a-43ff-b815-da164c812cf2" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-24e0ff07-168a-43ff-b815-da164c812cf2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-afa1f148-a761-45b5-9b2e-711a984c70a1" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-afa1f148-a761-45b5-9b2e-711a984c70a1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Deleting offline snapshot afa1f148-a761-45b5-9b2e-711a984c70a1 of volume 24e0ff07-168a-43ff-b815-da164c812cf2 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:19:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] snapshot_file for this snap is: volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:19:49 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa528cd-ef71-41e1-bfd0-c01c65f58685]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:49 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 Aug 26 16:19:49 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:50 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1" returned: 0 in 0.452s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24e0ff07-168a-43ff-b815-da164c812cf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[04581847-5a14-4748-8a0d-370ece2e3183]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:50 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2 Aug 26 16:19:50 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Flow 'volume_create_manager' (bb68a732-7827-45e0-b400-746e2d92c929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7697a362-f3da-4b28-beff-32cdc3534d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7697a362-f3da-4b28-beff-32cdc3534d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1905469146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4adc2f0daaf4bab9f18060ec9efc3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:50Z,use_quota=True,user_id='ee129218d8af47da8b27be3482a7b2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7280c3-e098-4db8-a9a2-306fd8748a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7280c3-e098-4db8-a9a2-306fd8748a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a18ec0c-0a83-4d71-ba0c-1ef78189f0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a18ec0c-0a83-4d71-ba0c-1ef78189f0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0', 'volume_name': 'volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e321e74c-7c97-48b6-8a35-e1d9acff120b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e321e74c-7c97-48b6-8a35-e1d9acff120b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669d7077-f84c-4cd3-9849-09d65cb53184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:50 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Volume 60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0', 'volume_size': 1} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1905469146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4adc2f0daaf4bab9f18060ec9efc3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:50Z,use_quota=True,user_id='ee129218d8af47da8b27be3482a7b2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Creating volume 60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:50 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:50 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0 1073741824 Aug 26 16:19:50 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:50 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2" returned: 0 in 0.497s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:50 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 Aug 26 16:19:50 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:51 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1" returned: 0 in 0.435s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:51 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0 1073741824" returned: 0 in 0.553s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:51 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1 Aug 26 16:19:51 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:51 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0 Aug 26 16:19:51 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:19:51 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Flow 'volume_create_manager' (bb0b4924-5071-4d03-9852-467f575f5d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42499125-8383-4597-bb81-6ee38993b7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2.afa1f148-a761-45b5-9b2e-711a984c70a1" returned: 0 in 0.484s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42499125-8383-4597-bb81-6ee38993b7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1377277384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308c7f79-1b94-4dfa-b131-85a704d73d77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc0e7bf25a324f29b960691341f2aaad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:51Z,use_quota=True,user_id='15ad1ebd7db04286bcee2de16c106763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fbd5e85-ab37-4b03-b095-0a9d97f071e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fbd5e85-ab37-4b03-b095-0a9d97f071e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2932bda1-3232-44c4-b291-5964de5a5b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2932bda1-3232-44c4-b291-5964de5a5b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308c7f79-1b94-4dfa-b131-85a704d73d77', 'volume_name': 'volume-308c7f79-1b94-4dfa-b131-85a704d73d77', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0af1aa-b92e-4d26-b356-724c2570388d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:51 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0af1aa-b92e-4d26-b356-724c2570388d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74751327-1a9e-40c9-88a2-90ac347d05bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:51 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Volume 308c7f79-1b94-4dfa-b131-85a704d73d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308c7f79-1b94-4dfa-b131-85a704d73d77', 'volume_size': 1} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-afa1f148-a761-45b5-9b2e-711a984c70a1" released by "_delete_snapshot" :: held 2.083s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0" returned: 0 in 0.487s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1377277384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308c7f79-1b94-4dfa-b131-85a704d73d77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc0e7bf25a324f29b960691341f2aaad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:51Z,use_quota=True,user_id='15ad1ebd7db04286bcee2de16c106763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Creating volume 308c7f79-1b94-4dfa-b131-85a704d73d77 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:51 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-308c7f79-1b94-4dfa-b131-85a704d73d77 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-24e0ff07-168a-43ff-b815-da164c812cf2" released by "delete_snapshot" :: held 2.145s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:51 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-308c7f79-1b94-4dfa-b131-85a704d73d77 1073741824 Aug 26 16:19:51 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669d7077-f84c-4cd3-9849-09d65cb53184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b65222f-c745-4d65-aad7-a63c7a1f0e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:51 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Volume volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0 (60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0): created successfully Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b65222f-c745-4d65-aad7-a63c7a1f0e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Flow 'volume_create_manager' (bb68a732-7827-45e0-b400-746e2d92c929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ad23ee05-6cad-4945-a319-439be61c99ec tempest-VolumesListTestJSON-737425006 None] Created volume successfully. Aug 26 16:19:51 devstack cinder-volume[94407]: WARNING cinder.quota [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2048177045 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2048177045, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:19:51 devstack cinder-volume[94407]: WARNING cinder.quota [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2048177045 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2048177045, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:19:51 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Created reservations ['dc221e0e-f8c8-4750-92d7-2b6f3823926a', '4c32238c-b4a8-4651-b3e4-d6cf71e6c013', 'abaf20a7-b0bf-46f8-95a4-2cef16dc17c2', 'a2d01bc2-16a3-4587-9f05-53fcc7895771'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:52 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] Created reservations ['43c53bd5-4db0-46a8-89bb-6dcd33d9c41e', '3e2a83af-0520-4548-bd68-2953e6d323a3', '30890bdb-6d73-4913-844a-1a4b83df92f3', '5504b8f6-db69-40bb-a398-c1e86540e291'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:52 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7a498aff-e8ec-49db-9521-597e3226c627 tempest-GroupSnapshotsTest-1937328690 None] group_snapshot a5e50612-63c8-412a-bd89-673e07f4cbb0: deleted successfully Aug 26 16:19:52 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-308c7f79-1b94-4dfa-b131-85a704d73d77 1073741824" returned: 0 in 0.609s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-308c7f79-1b94-4dfa-b131-85a704d73d77 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:52 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-308c7f79-1b94-4dfa-b131-85a704d73d77 Aug 26 16:19:52 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:52 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-308c7f79-1b94-4dfa-b131-85a704d73d77" returned: 0 in 0.282s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:52 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:19:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74751327-1a9e-40c9-88a2-90ac347d05bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308c7f79-1b94-4dfa-b131-85a704d73d77', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148db5c0-20cf-4831-83bd-69325d7aadec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:52 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Volume volume-308c7f79-1b94-4dfa-b131-85a704d73d77 (308c7f79-1b94-4dfa-b131-85a704d73d77): created successfully Aug 26 16:19:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148db5c0-20cf-4831-83bd-69325d7aadec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Flow 'volume_create_manager' (bb0b4924-5071-4d03-9852-467f575f5d17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:52 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-84ddbc29-39fb-4f8f-b768-ea89efe1a145 req-9ad87476-4c96-4392-b5e8-eaa12aac9a95 tempest-VolumesGetTestJSON-343489515 None] Created volume successfully. Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Flow 'volume_create_manager' (970c9274-1150-4154-8f25-944567eecc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98c2583-3d71-4d7c-babd-61368d388573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98c2583-3d71-4d7c-babd-61368d388573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1996993289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f990f4c-b53d-4f38-a3ec-67e31e716a7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4adc2f0daaf4bab9f18060ec9efc3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:53Z,use_quota=True,user_id='ee129218d8af47da8b27be3482a7b2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96631b02-7915-460b-9af1-01288efd11ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96631b02-7915-460b-9af1-01288efd11ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011554cf-b48b-4a85-aca5-aa0840e36c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011554cf-b48b-4a85-aca5-aa0840e36c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f990f4c-b53d-4f38-a3ec-67e31e716a7b', 'volume_name': 'volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10017ce7-9c35-402f-902b-5524e5459cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10017ce7-9c35-402f-902b-5524e5459cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79c78ba-6570-4847-bd82-dcb6e5c1fbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:53 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Volume 0f990f4c-b53d-4f38-a3ec-67e31e716a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b', 'volume_size': 1} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1996993289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f990f4c-b53d-4f38-a3ec-67e31e716a7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4adc2f0daaf4bab9f18060ec9efc3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:53Z,use_quota=True,user_id='ee129218d8af47da8b27be3482a7b2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Creating volume 0f990f4c-b53d-4f38-a3ec-67e31e716a7b {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:53 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:53 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b 1073741824 Aug 26 16:19:53 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-010dd6ed-a548-4f15-bc19-349de95bf835" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-010dd6ed-a548-4f15-bc19-349de95bf835" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4ea1f9-51b0-4769-a0b7-5b9705c6464a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:53 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835 Aug 26 16:19:53 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:53 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b 1073741824" returned: 0 in 0.596s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Acquiring lock "cinder-308c7f79-1b94-4dfa-b131-85a704d73d77-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Lock "cinder-308c7f79-1b94-4dfa-b131-85a704d73d77-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:54 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b Aug 26 16:19:54 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Acquiring lock "cinder-quobyte-308c7f79-1b94-4dfa-b131-85a704d73d77" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Lock "cinder-quobyte-308c7f79-1b94-4dfa-b131-85a704d73d77" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aded7cb-6757-4f2d-ba46-aead2cae3ca5]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-308c7f79-1b94-4dfa-b131-85a704d73d77 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:54 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835" returned: 0 in 0.528s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:54 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835 Aug 26 16:19:54 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:54 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-308c7f79-1b94-4dfa-b131-85a704d73d77 Aug 26 16:19:54 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:54 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b" returned: 0 in 0.329s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79c78ba-6570-4847-bd82-dcb6e5c1fbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc3e25f-a50b-4599-b785-5122a70cb2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:54 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Volume volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b (0f990f4c-b53d-4f38-a3ec-67e31e716a7b): created successfully Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc3e25f-a50b-4599-b785-5122a70cb2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Flow 'volume_create_manager' (970c9274-1150-4154-8f25-944567eecc2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:54 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-69d146ca-d62a-4ba9-8256-eefa9629a0a4 tempest-VolumesListTestJSON-737425006 None] Created volume successfully. Aug 26 16:19:54 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-010dd6ed-a548-4f15-bc19-349de95bf835" returned: 0 in 0.293s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-010dd6ed-a548-4f15-bc19-349de95bf835" released by "delete_volume" :: held 0.936s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-24e0ff07-168a-43ff-b815-da164c812cf2" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-24e0ff07-168a-43ff-b815-da164c812cf2" acquired by "delete_volume" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc0e125-2d5d-42ae-a3de-49d1146af1d1]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:54 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-308c7f79-1b94-4dfa-b131-85a704d73d77" returned: 0 in 0.473s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-308c7f79-1b94-4dfa-b131-85a704d73d77 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:54 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-308c7f79-1b94-4dfa-b131-85a704d73d77 Aug 26 16:19:54 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:54 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2 Aug 26 16:19:54 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:54 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-308c7f79-1b94-4dfa-b131-85a704d73d77" returned: 0 in 0.270s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Lock "cinder-quobyte-308c7f79-1b94-4dfa-b131-85a704d73d77" released by "delete_volume" :: held 0.801s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:54 devstack cinder-volume[94407]: DEBUG cinder.quota [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Created reservations ['ec80bd5e-9308-456d-b852-20117180b8c1', '59819540-5293-45ca-a66a-9db0fac80cb4', '9ccd1a08-9e51-473c-98f5-62c0225e7e73', 'b5979f01-2857-41a0-87a7-7bf37b9ba9ff'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:55 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2" returned: 0 in 0.430s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:55 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2 Aug 26 16:19:55 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:55 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:19:55 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:55 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.289s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:55 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG cinder.manager [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-24e0ff07-168a-43ff-b815-da164c812cf2" returned: 0 in 0.347s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Deleted volume successfully. Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-24e0ff07-168a-43ff-b815-da164c812cf2" released by "delete_volume" :: held 0.851s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-155c0123-7100-4431-aab5-81ac7b24fdbe req-5b931712-b934-4068-9d38-521f60917a14 tempest-VolumesGetTestJSON-343489515 None] Lock "cinder-308c7f79-1b94-4dfa-b131-85a704d73d77-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Created reservations ['3111b8af-5778-4b50-a620-187835a98b73'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:55 devstack cinder-volume[94407]: WARNING cinder.quota [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2048177045 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2048177045, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Created reservations ['4ca5d0ed-60c0-43d6-bc7b-7df00bca6996', 'eca92b39-9d00-4c32-8961-5b8b51888f99', 'c1200f8e-9047-40da-b292-9330752b958a', '672e69bf-93a9-47ba-9002-e0d96543a943'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Created reservations ['58e3be49-dfd8-4397-9b31-9a51f5dbdba0', 'b2b1f95f-f51d-4a57-8996-9e67de524286', '08f044aa-7495-4783-b8a2-9a98593058ee', '014c6ec6-be18-4114-858a-50e4a44ed230'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:55 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:19:55 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:56 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.270s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:56 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:19:56 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2f303458-a561-4ee9-bb68-ec30ade412e8 tempest-GroupSnapshotsTest-1937328690 None] Delete group completed successfully. Aug 26 16:19:56 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9431aefa-59b3-443d-8135-76ec63b7c0b0 tempest-GroupSnapshotsTest-1937328690 None] Group tempest-GroupSnapshotsTest-Group-1234874652: creating Aug 26 16:19:56 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9431aefa-59b3-443d-8135-76ec63b7c0b0 tempest-GroupSnapshotsTest-1937328690 None] Group tempest-GroupSnapshotsTest-Group-1234874652: created successfully Aug 26 16:19:56 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9431aefa-59b3-443d-8135-76ec63b7c0b0 tempest-GroupSnapshotsTest-1937328690 None] Create group completed successfully. Aug 26 16:19:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Acquiring lock "cinder-0f990f4c-b53d-4f38-a3ec-67e31e716a7b-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Lock "cinder-0f990f4c-b53d-4f38-a3ec-67e31e716a7b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Acquiring lock "cinder-quobyte-0f990f4c-b53d-4f38-a3ec-67e31e716a7b" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Lock "cinder-quobyte-0f990f4c-b53d-4f38-a3ec-67e31e716a7b" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:57 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b12c50-c67d-41af-aa9d-68d4d03e0522]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:57 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b Aug 26 16:19:57 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:58 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b" returned: 0 in 0.412s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:58 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b Aug 26 16:19:58 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Flow 'volume_create_manager' (a1f6339e-3bcb-459a-83f1-7a60555d92d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b427b63-7042-472f-8dca-05a400c628f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b427b63-7042-472f-8dca-05a400c628f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1509697218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d2735a1-6711-4634-b552-82ee55511735,host='devstack@QuobyteHD#QuobyteHD',id=0a15eac4-144d-4630-9ed2-4cfec2463c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f439953608394212af08324a451b0d08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:58Z,use_quota=True,user_id='f74662b93bec404b9af0e795fbd9f26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(655e39e1-7c50-4b99-9ed0-a3957f9e3a06),volume_type_id=655e39e1-7c50-4b99-9ed0-a3957f9e3a06)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d4a3b5-0004-4836-8127-91f2466f5e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d4a3b5-0004-4836-8127-91f2466f5e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd41b41-377b-46a0-a650-590e9fc33d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd41b41-377b-46a0-a650-590e9fc33d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a15eac4-144d-4630-9ed2-4cfec2463c89', 'volume_name': 'volume-0a15eac4-144d-4630-9ed2-4cfec2463c89', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84012498-cc29-4d29-8267-063c37ecabeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84012498-cc29-4d29-8267-063c37ecabeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53ac2f8-6047-4d5c-b8b2-cf828c4d2d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:58 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Volume 0a15eac4-144d-4630-9ed2-4cfec2463c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a15eac4-144d-4630-9ed2-4cfec2463c89', 'volume_size': 1} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5d2735a1-6711-4634-b552-82ee55511735,created_at=2026-08-26T14:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1509697218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d2735a1-6711-4634-b552-82ee55511735,host='devstack@QuobyteHD#QuobyteHD',id=0a15eac4-144d-4630-9ed2-4cfec2463c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f439953608394212af08324a451b0d08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:19:58Z,use_quota=True,user_id='f74662b93bec404b9af0e795fbd9f26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(655e39e1-7c50-4b99-9ed0-a3957f9e3a06),volume_type_id=655e39e1-7c50-4b99-9ed0-a3957f9e3a06)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Creating volume 0a15eac4-144d-4630-9ed2-4cfec2463c89 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:19:58 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:58 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 1073741824 Aug 26 16:19:58 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:58 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0f990f4c-b53d-4f38-a3ec-67e31e716a7b" returned: 0 in 0.286s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Lock "cinder-quobyte-0f990f4c-b53d-4f38-a3ec-67e31e716a7b" released by "delete_volume" :: held 0.749s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Created reservations ['fbb4e0ae-c213-446c-a446-79348b32ff7d', 'e93b504a-e5ef-46f1-9a0e-799ac663622a', 'ee8d8bd1-4f57-4571-a747-0f3690a2acd7', 'c0b19e6c-9187-4550-b4f8-4a0ada66d229'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:58 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:19:58 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Acquiring lock "cinder-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Lock "cinder-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Acquiring lock "cinder-quobyte-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:19:58 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:58 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 1073741824" returned: 0 in 0.577s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.342s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Lock "cinder-quobyte-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0" acquired by "delete_volume" :: waited 0.032s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:19:59 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Deleted volume successfully. Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[185b6fc0-3f88-4fd6-857d-9ea9f7ea169d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-952b3071-dca7-4844-8110-31af45f3ecd7 tempest-VolumesListTestJSON-737425006 None] Lock "cinder-0f990f4c-b53d-4f38-a3ec-67e31e716a7b-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:59 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 Aug 26 16:19:59 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:59 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0 Aug 26 16:19:59 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:59 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89" returned: 0 in 0.251s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53ac2f8-6047-4d5c-b8b2-cf828c4d2d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a15eac4-144d-4630-9ed2-4cfec2463c89', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655b4cc3-a7c3-41fb-91a2-f8f0c6b57f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:19:59 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Volume volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 (0a15eac4-144d-4630-9ed2-4cfec2463c89): created successfully Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655b4cc3-a7c3-41fb-91a2-f8f0c6b57f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Flow 'volume_create_manager' (a1f6339e-3bcb-459a-83f1-7a60555d92d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:19:59 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9c217252-835e-4746-9c94-011351f203b7 tempest-GroupSnapshotsTest-1937328690 None] Created volume successfully. Aug 26 16:19:59 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0" returned: 0 in 0.384s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:59 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0 Aug 26 16:19:59 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:59 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0" returned: 0 in 0.273s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Lock "cinder-quobyte-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0" released by "delete_volume" :: held 0.706s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Created reservations ['cbefd450-e3b0-4b03-8928-ae1ee82456c8', '94a081f1-a225-4b23-9b38-6cf5068a12e5', 'e06f859f-0c3e-4dde-8df0-bd35d9e05afb', '0656e4c7-0b18-46c4-a597-87a6e8d6c777'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:19:59 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] GroupSnapshot b0889696-8884-41eb-9dde-b3d7436d17ba: creating. Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] Group snapshot b0889696-8884-41eb-9dde-b3d7436d17ba: creating. {{(pid=94407) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:19:59 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:19:59 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] Creating offline snapshot 8c5df921-0942-48fc-a2cb-f153f3b8f830 of volume 0a15eac4-144d-4630-9ed2-4cfec2463c89 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f264ae-3728-441b-989c-350869d90a04]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:19:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:00 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 Aug 26 16:20:00 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Acquiring lock "cinder-20bf8433-4427-4e78-8b91-5361bca98c63-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:00 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.323s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Lock "cinder-20bf8433-4427-4e78-8b91-5361bca98c63-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:00 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Deleted volume successfully. Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e2f91798-0d16-4e8f-b4a0-6e8abb3428a7 tempest-VolumesListTestJSON-737425006 None] Lock "cinder-60218c2f-812f-4fd8-b8cf-f3bea2f8d1a0-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Acquiring lock "cinder-quobyte-20bf8433-4427-4e78-8b91-5361bca98c63" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Lock "cinder-quobyte-20bf8433-4427-4e78-8b91-5361bca98c63" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[21035cb0-c5e3-49f2-8e0e-c7ca04b83aab]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20bf8433-4427-4e78-8b91-5361bca98c63 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:00 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20bf8433-4427-4e78-8b91-5361bca98c63 Aug 26 16:20:00 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:00 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89" returned: 0 in 0.504s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:00 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 1G Aug 26 16:20:00 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:00 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20bf8433-4427-4e78-8b91-5361bca98c63" returned: 0 in 0.411s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20bf8433-4427-4e78-8b91-5361bca98c63 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:00 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20bf8433-4427-4e78-8b91-5361bca98c63 Aug 26 16:20:00 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:00 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 1G" returned: 0 in 0.544s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:01 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 Aug 26 16:20:01 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:01 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20bf8433-4427-4e78-8b91-5361bca98c63" returned: 0 in 0.357s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Lock "cinder-quobyte-20bf8433-4427-4e78-8b91-5361bca98c63" released by "delete_volume" :: held 0.816s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Created reservations ['4626f265-977d-4c71-bebe-2ce45efaf11e', '9f0ae954-af02-4bff-93e0-da4ee721c77e', '0f7d3fb2-3c65-41b9-a53b-dc3b81de1b57', '25304333-4eac-4384-8f37-bc36c483ad29'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:01 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:20:01 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:01 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830" returned: 0 in 0.425s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:01 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:01 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 Aug 26 16:20:01 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:01 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.458s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:20:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Deleted volume successfully. Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e0d1b204-947b-4150-ab0c-61fa3b696219 tempest-VolumesListTestJSON-737425006 None] Lock "cinder-20bf8433-4427-4e78-8b91-5361bca98c63-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:01 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830" returned: 0 in 0.441s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:01 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.info Aug 26 16:20:01 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:02 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.info" returned: 0 in 0.356s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:02 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:20:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:02 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.info Aug 26 16:20:02 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:02 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.info" returned: 0 in 0.504s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.876s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:02 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-87a007a5-6255-459a-a9dc-71ed847b053d tempest-GroupSnapshotsTest-1937328690 None] group_snapshot b0889696-8884-41eb-9dde-b3d7436d17ba: created successfully Aug 26 16:20:03 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] group_snapshot b0889696-8884-41eb-9dde-b3d7436d17ba: deleting Aug 26 16:20:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] group_snapshot b0889696-8884-41eb-9dde-b3d7436d17ba: deleting {{(pid=94407) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 16:20:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-0a15eac4-144d-4630-9ed2-4cfec2463c89" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-0a15eac4-144d-4630-9ed2-4cfec2463c89" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-8c5df921-0942-48fc-a2cb-f153f3b8f830" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-8c5df921-0942-48fc-a2cb-f153f3b8f830" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Deleting offline snapshot 8c5df921-0942-48fc-a2cb-f153f3b8f830 of volume 0a15eac4-144d-4630-9ed2-4cfec2463c89 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:20:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] snapshot_file for this snap is: volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:20:03 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ce29ab-fdef-4c95-ac7e-1e8a132e913b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:03 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 Aug 26 16:20:03 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:04 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830" returned: 0 in 0.459s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a15eac4-144d-4630-9ed2-4cfec2463c89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:20:04 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eddcfe-90bf-4915-b2df-e359a006e9ef]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:04 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 Aug 26 16:20:04 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:04 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89" returned: 0 in 0.508s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:04 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 Aug 26 16:20:04 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:05 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830" returned: 0 in 0.420s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:05 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830 Aug 26 16:20:05 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:05 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89.8c5df921-0942-48fc-a2cb-f153f3b8f830" returned: 0 in 0.365s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-8c5df921-0942-48fc-a2cb-f153f3b8f830" released by "_delete_snapshot" :: held 1.922s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-0a15eac4-144d-4630-9ed2-4cfec2463c89" released by "delete_snapshot" :: held 1.960s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:05 devstack cinder-volume[94407]: WARNING cinder.quota [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1621242 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1621242, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:20:05 devstack cinder-volume[94407]: WARNING cinder.quota [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1621242 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1621242, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:20:05 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] Created reservations ['c3baf80b-b3d4-46d0-bacb-5c38212978f7', '3b9b6ec2-4bfb-46c1-aa5a-971121830ec3', '6ae8eaf0-649e-4e94-9b6c-bba6cfe07b3a', 'a26cbf1b-2f03-4c72-9aef-dc4a20bc9ae8'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:05 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b05a940e-4249-4796-bca2-9784e1a3ea27 tempest-GroupSnapshotsTest-1937328690 None] group_snapshot b0889696-8884-41eb-9dde-b3d7436d17ba: deleted successfully Aug 26 16:20:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-492087f2-63b4-4d0d-a0fb-54e2cbee4ac0 tempest-GroupsV314Test-2062939434 None] Group tempest-GroupsV314Test-Group-602023200: creating Aug 26 16:20:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-492087f2-63b4-4d0d-a0fb-54e2cbee4ac0 tempest-GroupsV314Test-2062939434 None] Group tempest-GroupsV314Test-Group-602023200: created successfully Aug 26 16:20:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-492087f2-63b4-4d0d-a0fb-54e2cbee4ac0 tempest-GroupsV314Test-2062939434 None] Create group completed successfully. Aug 26 16:20:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "cinder-quobyte-0a15eac4-144d-4630-9ed2-4cfec2463c89" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-0a15eac4-144d-4630-9ed2-4cfec2463c89" acquired by "delete_volume" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:07 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e1ee11-03bd-4ad2-b2fb-0938683fe65d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:07 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 Aug 26 16:20:07 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:07 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89" returned: 0 in 0.645s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:07 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-b6c86c5f-37cf-4337-b610-48486b620288 req-8b08b4f6-075e-48f5-b241-eb99644637aa tempest-TestMinimumBasicScenario-341467877 None] Terminate volume connection completed successfully. Aug 26 16:20:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-b6c86c5f-37cf-4337-b610-48486b620288 req-8b08b4f6-075e-48f5-b241-eb99644637aa tempest-TestMinimumBasicScenario-341467877 None] Deleting attachment 285396ec-1508-4d6e-a404-f0f043b144d7. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:20:07 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89 Aug 26 16:20:07 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Flow 'volume_create_manager' (8d351a90-3b65-4974-8eaf-537f831b7536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e528e6b3-80ba-4094-81de-f7f264841a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e528e6b3-80ba-4094-81de-f7f264841a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-725821040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ccb0d540-fe53-4ed2-aa6a-863f332c79ca,host='devstack@QuobyteHD#QuobyteHD',id=239f5be6-fcb1-44b0-91c3-153c0d3d890d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce791d2a2c4d4fb69dcac64e770154bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:20:08Z,use_quota=True,user_id='938824cd6d78417c8f79a54b9f185a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abf6edf0-1814-45f3-b309-a391163ca5d7),volume_type_id=abf6edf0-1814-45f3-b309-a391163ca5d7)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3b2ee3-02af-46fb-bb3e-12099f739084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3b2ee3-02af-46fb-bb3e-12099f739084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86725271-58fc-4c06-a8ab-b81be0ea0536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86725271-58fc-4c06-a8ab-b81be0ea0536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '239f5be6-fcb1-44b0-91c3-153c0d3d890d', 'volume_name': 'volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3fefbf-018d-4b69-863e-69400bc8ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3fefbf-018d-4b69-863e-69400bc8ec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3fabea0-54cd-46d1-89cf-9514d975337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:08 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Volume 239f5be6-fcb1-44b0-91c3-153c0d3d890d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d', 'volume_size': 1} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ccb0d540-fe53-4ed2-aa6a-863f332c79ca,created_at=2026-08-26T14:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-725821040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ccb0d540-fe53-4ed2-aa6a-863f332c79ca,host='devstack@QuobyteHD#QuobyteHD',id=239f5be6-fcb1-44b0-91c3-153c0d3d890d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce791d2a2c4d4fb69dcac64e770154bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:20:08Z,use_quota=True,user_id='938824cd6d78417c8f79a54b9f185a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abf6edf0-1814-45f3-b309-a391163ca5d7),volume_type_id=abf6edf0-1814-45f3-b309-a391163ca5d7)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Creating volume 239f5be6-fcb1-44b0-91c3-153c0d3d890d {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:20:08 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:08 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d 1073741824 Aug 26 16:20:08 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:08 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0a15eac4-144d-4630-9ed2-4cfec2463c89" returned: 0 in 0.529s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Lock "cinder-quobyte-0a15eac4-144d-4630-9ed2-4cfec2463c89" released by "delete_volume" :: held 1.260s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Created reservations ['add0ccb1-28ba-47d0-af26-891effd6f989'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Acquiring lock "cinder-7d0c31fd-caad-42d9-8486-8b214790310b-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:08 devstack cinder-volume[94407]: WARNING cinder.quota [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1621242 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1621242, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Lock "cinder-7d0c31fd-caad-42d9-8486-8b214790310b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Created reservations ['a82678f7-c03a-4cd2-83a0-fc54de04ad77', '7b417610-1a64-4710-ab85-70eecb830e76', 'b3ff2375-a796-4aa0-a90e-a5203f2ef9c8', '92236e59-dc1a-4b52-b9f7-046746778a85'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Acquiring lock "cinder-quobyte-7d0c31fd-caad-42d9-8486-8b214790310b" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Lock "cinder-quobyte-7d0c31fd-caad-42d9-8486-8b214790310b" acquired by "delete_volume" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[637e2dc5-20aa-4df9-a51c-cc1af9778785]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d0c31fd-caad-42d9-8486-8b214790310b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:08 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:20:08 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:08 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d0c31fd-caad-42d9-8486-8b214790310b Aug 26 16:20:08 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:09 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d 1073741824" returned: 0 in 0.656s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:09 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d Aug 26 16:20:09 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:09 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.284s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:20:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-92aab4dd-85c4-430e-bb9a-6bc33966a2cd tempest-GroupSnapshotsTest-1937328690 None] Delete group completed successfully. Aug 26 16:20:09 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d0c31fd-caad-42d9-8486-8b214790310b" returned: 0 in 0.426s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d0c31fd-caad-42d9-8486-8b214790310b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:09 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d0c31fd-caad-42d9-8486-8b214790310b Aug 26 16:20:09 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:09 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d" returned: 0 in 0.293s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3fabea0-54cd-46d1-89cf-9514d975337e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6565bb-a69a-4233-bd38-279367cfdeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:09 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Volume volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d (239f5be6-fcb1-44b0-91c3-153c0d3d890d): created successfully Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6565bb-a69a-4233-bd38-279367cfdeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Flow 'volume_create_manager' (8d351a90-3b65-4974-8eaf-537f831b7536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:20:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-50a8ff79-9a15-4065-97f8-78222b3f3367 tempest-GroupsV314Test-2062939434 None] Created volume successfully. Aug 26 16:20:09 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d0c31fd-caad-42d9-8486-8b214790310b" returned: 0 in 0.290s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Lock "cinder-quobyte-7d0c31fd-caad-42d9-8486-8b214790310b" released by "delete_volume" :: held 0.766s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Created reservations ['2ff30c9c-fbc7-4b25-b2d4-b2bbb30d6d71', 'c18b7676-c02e-4ebd-8030-163f5b99e4c7', 'd76c0929-350b-4086-bd5c-051ab4fe633d', '9beb6a92-6303-437c-8747-98cca853e810'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:09 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:20:09 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:09 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.309s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:09 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:20:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Deleted volume successfully. Aug 26 16:20:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78c73fe9-34d1-4af2-ab5f-44d715034ff0 tempest-TestMinimumBasicScenario-341467877 None] Lock "cinder-7d0c31fd-caad-42d9-8486-8b214790310b-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:11 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Cloning volume 239f5be6-fcb1-44b0-91c3-153c0d3d890d to volume 7295d9eb-7c3d-4b64-8d7d-4f6879de9eae Aug 26 16:20:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Creating offline snapshot 0d39f5aa-343a-4eef-a55e-ce9e0f249539 of volume 239f5be6-fcb1-44b0-91c3-153c0d3d890d {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:20:11 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[90627d79-6f84-4308-8d4a-c28e64cf7ed1]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:11 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d Aug 26 16:20:11 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:12 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d" returned: 0 in 0.434s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:12 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 1G Aug 26 16:20:12 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:12 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 1G" returned: 0 in 0.538s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:12 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 Aug 26 16:20:12 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:13 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539" returned: 0 in 0.474s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:13 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:20:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:13 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 Aug 26 16:20:13 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:13 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539" returned: 0 in 0.294s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:13 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.info Aug 26 16:20:13 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:13 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.info" returned: 0 in 0.306s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:13 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:20:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:13 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.info Aug 26 16:20:13 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:14 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.info" returned: 0 in 0.340s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Acquiring lock "cinder-quobyte-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae" by "_copy_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Lock "cinder-quobyte-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] snapshot: 0d39f5aa-343a-4eef-a55e-ce9e0f249539, volume: 7295d9eb-7c3d-4b64-8d7d-4f6879de9eae, {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4dcf49-c17a-4665-9c42-f9b051ea1602]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:14 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 Aug 26 16:20:14 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:14 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539" returned: 0 in 0.440s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ee1591-ae95-4001-a700-95cdb591ae28]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:14 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d Aug 26 16:20:14 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:15 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d" returned: 0 in 0.413s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] will copy from snapshot at /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 16:20:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Creating direct copy from snapshot {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 16:20:15 devstack cinder-volume[94407]: DEBUG cinder.utils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Path /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae not found in is_blk_device check {{(pid=94407) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 16:20:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:15 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae Aug 26 16:20:15 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:20:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:18 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:20:18 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:18 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.830s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:20:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:20:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 28 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:20:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:20:21 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae" returned: 0 in 6.323s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:21 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:20:21 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Converted 1024.00 MB image at 161.81 MB/s Aug 26 16:20:21 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae is being set with open permissions: ugo+rw: NotImplementedError Aug 26 16:20:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:21 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae Aug 26 16:20:21 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:21 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae" returned: 0 in 0.408s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Lock "cinder-quobyte-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae" released by "_copy_volume_from_snapshot" :: held 7.684s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Acquiring lock "cinder-quobyte-0d39f5aa-343a-4eef-a55e-ce9e0f249539" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Lock "cinder-quobyte-0d39f5aa-343a-4eef-a55e-ce9e0f249539" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Deleting offline snapshot 0d39f5aa-343a-4eef-a55e-ce9e0f249539 of volume 239f5be6-fcb1-44b0-91c3-153c0d3d890d {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:20:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] snapshot_file for this snap is: volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:20:22 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55b8785-e1de-4558-8da1-3d8facff2036]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:22 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 Aug 26 16:20:22 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:22 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539" returned: 0 in 0.558s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:20:22 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[af15ef6d-9ae9-41a6-ae68-7c4f4dc797f6]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:22 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d Aug 26 16:20:22 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:23 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d" returned: 0 in 0.650s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:23 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 Aug 26 16:20:23 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:23 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=129,cinder:INSERT=41,cinder:UPDATE=152,cinder:DELETE=10 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:20:23 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539" returned: 0 in 0.533s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:23 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539 Aug 26 16:20:23 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:24 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d.0d39f5aa-343a-4eef-a55e-ce9e0f249539" returned: 0 in 0.327s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Lock "cinder-quobyte-0d39f5aa-343a-4eef-a55e-ce9e0f249539" released by "_delete_snapshot" :: held 2.211s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.544s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:24 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-eaae1039-1ef8-483e-abd7-689ca9359eaf tempest-GroupsV314Test-2062939434 None] Create group from source-group-ccb0d540-fe53-4ed2-aa6a-863f332c79ca completed successfully. Aug 26 16:20:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Acquiring lock "cinder-quobyte-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Lock "cinder-quobyte-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae" acquired by "delete_volume" :: waited 0.027s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:25 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ba7e62-28a3-4db7-9d36-87ad8c34f2ad]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:25 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae Aug 26 16:20:25 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:26 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae" returned: 0 in 0.461s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:26 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae Aug 26 16:20:26 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:26 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae" returned: 0 in 0.359s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:26 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Lock "cinder-quobyte-7295d9eb-7c3d-4b64-8d7d-4f6879de9eae" released by "delete_volume" :: held 0.881s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:26 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Created reservations ['4ecea7c2-f507-4327-aedb-638610127ad8'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:26 devstack cinder-volume[94407]: WARNING cinder.quota [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2109074083 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2109074083, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:20:26 devstack cinder-volume[94407]: WARNING cinder.quota [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2109074083 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2109074083, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:20:26 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Created reservations ['bc0b871c-96f1-476a-adb9-5f113f5a3178', 'f67e1974-2b47-432c-82b6-e8806f793197', 'dbaed280-4e33-444a-9673-89784a08189a', 'c1ef3dd4-33f9-4617-aa41-8b8bb02c823d'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:26 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:26 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:26 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:20:26 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Acquiring lock "cinder-quobyte-239f5be6-fcb1-44b0-91c3-153c0d3d890d" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Lock "cinder-quobyte-239f5be6-fcb1-44b0-91c3-153c0d3d890d" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:27 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9c5f30-d6d5-4f93-b6d3-f8ff9d159921]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:27 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.460s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:27 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:20:27 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-748ee9b4-3791-4917-9e42-c4f28ff0cd96 tempest-GroupsV314Test-2062939434 None] Delete group completed successfully. Aug 26 16:20:27 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d Aug 26 16:20:27 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:27 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d" returned: 0 in 0.566s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:27 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d Aug 26 16:20:27 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:28 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-239f5be6-fcb1-44b0-91c3-153c0d3d890d" returned: 0 in 0.304s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Lock "cinder-quobyte-239f5be6-fcb1-44b0-91c3-153c0d3d890d" released by "delete_volume" :: held 0.961s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:28 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Created reservations ['82ab7bcb-ded8-4f31-a17d-53a15bf60754'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:28 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Created reservations ['ea5d3a25-0adf-4888-8062-d56b89488bd8', 'bd7103b1-df5c-4bd6-99ef-e5ff34c7ecb9', 'abffea1b-1663-421a-a234-8f25fd7c67f9', 'c1619a99-a384-435c-9960-e7a8fdf77f90'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:28 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:20:28 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:28 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.460s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:28 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:20:29 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-33134867-dfc2-4534-88c2-1ea21d9ac735 tempest-GroupsV314Test-2062939434 None] Delete group completed successfully. Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Flow 'volume_create_manager' (15c19d3d-4ab0-478e-ba26-f52aa41d6ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2512877f-b70b-4abf-86ef-ba4db00d2ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2512877f-b70b-4abf-86ef-ba4db00d2ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-250228517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e1d8e9-5598-4285-b317-ffe951f2fa35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b64b4255fb4c4248a950cfcc55b51721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:20:32Z,use_quota=True,user_id='465596aab4644c2880231ba3cbe40d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1098227-d996-4163-adb0-2d9ba3e71287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1098227-d996-4163-adb0-2d9ba3e71287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10077683-083f-49c8-9b64-2106ceebe4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10077683-083f-49c8-9b64-2106ceebe4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83e1d8e9-5598-4285-b317-ffe951f2fa35', 'volume_name': 'volume-83e1d8e9-5598-4285-b317-ffe951f2fa35', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30165395-4372-40de-96ef-6836b4606a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30165395-4372-40de-96ef-6836b4606a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbebe0ff-8599-4183-a772-4df27a3c9878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:32 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Volume 83e1d8e9-5598-4285-b317-ffe951f2fa35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83e1d8e9-5598-4285-b317-ffe951f2fa35', 'volume_size': 1} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-250228517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e1d8e9-5598-4285-b317-ffe951f2fa35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b64b4255fb4c4248a950cfcc55b51721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:20:32Z,use_quota=True,user_id='465596aab4644c2880231ba3cbe40d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Creating volume 83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:20:32 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:20:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:32 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 1073741824 Aug 26 16:20:32 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:33 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 1073741824" returned: 0 in 0.613s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:33 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 Aug 26 16:20:33 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:33 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35" returned: 0 in 0.313s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:20:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbebe0ff-8599-4183-a772-4df27a3c9878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e1d8e9-5598-4285-b317-ffe951f2fa35', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf13615-72f7-4e97-ab9f-5866c838b87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:33 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Volume volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 (83e1d8e9-5598-4285-b317-ffe951f2fa35): created successfully Aug 26 16:20:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf13615-72f7-4e97-ab9f-5866c838b87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Flow 'volume_create_manager' (15c19d3d-4ab0-478e-ba26-f52aa41d6ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:20:33 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e0e4b230-c836-4ff2-8fa4-3c5057e32d29 tempest-SnapshotsActionsTest-362247595 None] Created volume successfully. Aug 26 16:20:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:34 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] Creating offline snapshot 51940629-59ca-4a75-b1f0-f21cacc5f426 of volume 83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:20:34 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[695ebaee-5276-4a6b-8fd0-9b42ed6a21ad]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:35 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 Aug 26 16:20:35 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:35 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35" returned: 0 in 0.444s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:35 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 1G Aug 26 16:20:35 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:35 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 1G" returned: 0 in 0.527s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:35 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 Aug 26 16:20:35 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:36 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426" returned: 0 in 0.494s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:36 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 is being set with open permissions: ugo+rw Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:36 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 Aug 26 16:20:36 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Flow 'volume_create_manager' (31efe7a7-c379-4f52-b2e7-28bc7f8f414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fccd38-7c5d-4f29-ad52-7fbb2282f345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fccd38-7c5d-4f29-ad52-7fbb2282f345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-564032909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e6f983-eed4-45e5-aa3f-8c2566e161c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd80a9b50844e9d85c01a9df8fe3a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:20:37Z,use_quota=True,user_id='0c4592b9c324430db8cab99c3aab534d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ecd3152-9df0-485e-a382-fa25f599f50a),volume_type_id=9ecd3152-9df0-485e-a382-fa25f599f50a)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fc50e0-119a-42cf-a765-5e239fddf953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fc50e0-119a-42cf-a765-5e239fddf953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cac882-50f2-46f8-ba79-422bcce12433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cac882-50f2-46f8-ba79-422bcce12433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e6f983-eed4-45e5-aa3f-8c2566e161c6', 'volume_name': 'volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68bfcd0-c259-4f0f-b7f1-34ff42cf3378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68bfcd0-c259-4f0f-b7f1-34ff42cf3378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:36 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfdedf75-2749-45d7-9337-54960700c48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:36 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Volume 34e6f983-eed4-45e5-aa3f-8c2566e161c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6', 'volume_size': 1} Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426" returned: 0 in 0.503s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:36 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.info Aug 26 16:20:36 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:INSERT=49,cinder:SELECT=154,cinder:UPDATE=165,cinder:DELETE=6 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:20:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-1f656a48-dfec-4174-b50c-a1cf186fb251 tempest-GroupsV320Test-1619272834 None] Group tempest-GroupsV320Test-Group-1889903512: creating Aug 26 16:20:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-1f656a48-dfec-4174-b50c-a1cf186fb251 tempest-GroupsV320Test-1619272834 None] Group tempest-GroupsV320Test-Group-1889903512: created successfully Aug 26 16:20:37 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-1f656a48-dfec-4174-b50c-a1cf186fb251 tempest-GroupsV320Test-1619272834 None] Create group completed successfully. Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.info" returned: 0 in 0.403s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:37 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.info is being set with open permissions: ugo+rw Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:37 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.info Aug 26 16:20:37 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Flow 'volume_create_manager' (32f1bac6-5c84-41b6-be16-7ad40caa63c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdfc92a-7d5e-4a5e-bf01-452a045991ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdfc92a-7d5e-4a5e-bf01-452a045991ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-396089716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd80a9b50844e9d85c01a9df8fe3a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:20:37Z,use_quota=True,user_id='0c4592b9c324430db8cab99c3aab534d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b157721-5a33-4ab4-b900-d955f03e577c),volume_type_id=5b157721-5a33-4ab4-b900-d955f03e577c)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba9bf27-ac0e-4539-8435-dedc46c17e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba9bf27-ac0e-4539-8435-dedc46c17e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ecfe97-476e-4af3-b0cf-5670db98f073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ecfe97-476e-4af3-b0cf-5670db98f073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56', 'volume_name': 'volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:37 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118fe506-2708-48ba-a110-a53aa9666793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118fe506-2708-48ba-a110-a53aa9666793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42fe4f45-8415-4830-8863-99f2e8ab8cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:37 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Volume 4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56', 'volume_size': 1} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.info" returned: 0 in 0.331s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.825s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.817s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-564032909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e6f983-eed4-45e5-aa3f-8c2566e161c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd80a9b50844e9d85c01a9df8fe3a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:20:37Z,use_quota=True,user_id='0c4592b9c324430db8cab99c3aab534d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ecd3152-9df0-485e-a382-fa25f599f50a),volume_type_id=9ecd3152-9df0-485e-a382-fa25f599f50a)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Creating volume 34e6f983-eed4-45e5-aa3f-8c2566e161c6 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:20:37 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:20:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:37 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6 1073741824 Aug 26 16:20:37 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-df1197f8-7e72-463a-9307-f911ec3af00e tempest-SnapshotsActionsTest-362247595 None] Create snapshot completed successfully Aug 26 16:20:38 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6 1073741824" returned: 0 in 0.606s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:38 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6 Aug 26 16:20:38 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Flow 'volume_create_manager' (08e9a30d-4522-488f-94c4-a71e9d9e90fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f98a98-9b8c-461e-92a8-e29f7b29847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f98a98-9b8c-461e-92a8-e29f7b29847b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1300095872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be84bd9-93d7-4f37-a357-5d5453331888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd80a9b50844e9d85c01a9df8fe3a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:20:38Z,use_quota=True,user_id='0c4592b9c324430db8cab99c3aab534d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6076395-f75b-4b8c-8464-5f0fb1273737),volume_type_id=a6076395-f75b-4b8c-8464-5f0fb1273737)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3024910-4999-4aec-8ab3-99df7e34c6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3024910-4999-4aec-8ab3-99df7e34c6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7664437-7d91-409d-942f-4f3eb810dec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.image.glance [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Creating Keystone auth plugin from conf {{(pid=94407) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 16:20:38 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6" returned: 0 in 0.446s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-396089716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd80a9b50844e9d85c01a9df8fe3a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:20:37Z,use_quota=True,user_id='0c4592b9c324430db8cab99c3aab534d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b157721-5a33-4ab4-b900-d955f03e577c),volume_type_id=5b157721-5a33-4ab4-b900-d955f03e577c)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Creating volume 4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:20:38 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:38 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56 1073741824 Aug 26 16:20:38 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfdedf75-2749-45d7-9337-54960700c48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ad4867-b89f-481d-a1a0-dc07de4283ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:38 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Volume volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6 (34e6f983-eed4-45e5-aa3f-8c2566e161c6): created successfully Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ad4867-b89f-481d-a1a0-dc07de4283ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:38 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Flow 'volume_create_manager' (31efe7a7-c379-4f52-b2e7-28bc7f8f414b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:20:38 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-38aa2877-8bc7-4ff1-a8ff-3d58cf851498 tempest-TestInstancesWithCinderVolumes-824214854 None] Created volume successfully. Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-d37e8639-103d-41bf-8733-ba526df9e2a2 tempest-GroupsV320Test-1619272834 None] Created reservations ['3b0844e3-f368-4c11-bf63-dea9f332af26'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d37e8639-103d-41bf-8733-ba526df9e2a2 tempest-GroupsV320Test-1619272834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d37e8639-103d-41bf-8733-ba526df9e2a2 tempest-GroupsV320Test-1619272834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d37e8639-103d-41bf-8733-ba526df9e2a2 tempest-GroupsV320Test-1619272834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d37e8639-103d-41bf-8733-ba526df9e2a2 tempest-GroupsV320Test-1619272834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d37e8639-103d-41bf-8733-ba526df9e2a2 tempest-GroupsV320Test-1619272834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d37e8639-103d-41bf-8733-ba526df9e2a2 tempest-GroupsV320Test-1619272834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:39 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:20:39 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:39 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56 1073741824" returned: 0 in 0.668s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:39 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d37e8639-103d-41bf-8733-ba526df9e2a2 tempest-GroupsV320Test-1619272834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.430s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-d37e8639-103d-41bf-8733-ba526df9e2a2 tempest-GroupsV320Test-1619272834 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:20:39 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56 Aug 26 16:20:39 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:39 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-d37e8639-103d-41bf-8733-ba526df9e2a2 tempest-GroupsV320Test-1619272834 None] Delete group completed successfully. Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7664437-7d91-409d-942f-4f3eb810dec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1be84bd9-93d7-4f37-a357-5d5453331888', 'volume_name': 'volume-1be84bd9-93d7-4f37-a357-5d5453331888', 'volume_size': 1, 'image_id': '9b7727e6-57fc-4e87-a22c-525ed57a4e4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b7727e6-57fc-4e87-a22c-525ed57a4e4a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--637251734', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cfd80a9b50844e9d85c01a9df8fe3a0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b7727e6-57fc-4e87-a22c-525ed57a4e4a', 'created_at': datetime.datetime(2026, 8, 26, 14, 20, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 20, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b7727e6-57fc-4e87-a22c-525ed57a4e4a/file', 'properties': {}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9590d4-81b0-47c0-a8d0-82be548459b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9590d4-81b0-47c0-a8d0-82be548459b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aae2c6d-bc4c-4c6d-8f99-836b29f877b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:39 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Volume 1be84bd9-93d7-4f37-a357-5d5453331888: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1be84bd9-93d7-4f37-a357-5d5453331888', 'volume_size': 1, 'image_id': '9b7727e6-57fc-4e87-a22c-525ed57a4e4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b7727e6-57fc-4e87-a22c-525ed57a4e4a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--637251734', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cfd80a9b50844e9d85c01a9df8fe3a0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b7727e6-57fc-4e87-a22c-525ed57a4e4a', 'created_at': datetime.datetime(2026, 8, 26, 14, 20, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 20, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b7727e6-57fc-4e87-a22c-525ed57a4e4a/file', 'properties': {}}, 'image_service': } Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Trying to clone 1be84bd9-93d7-4f37-a357-5d5453331888 from image 9b7727e6-57fc-4e87-a22c-525ed57a4e4a at location (None, [{'url': 'file:///opt/stack/data/glance/images/9b7727e6-57fc-4e87-a22c-525ed57a4e4a', 'metadata': {}}]). {{(pid=94407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 16:20:39 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56" returned: 0 in 0.267s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.346s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42fe4f45-8415-4830-8863-99f2e8ab8cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40c804f-3006-4948-8fda-c3a76b31edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] Creating offline snapshot 7b35a5ab-a6a4-422b-ade4-dec1cf636012 of volume 83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:20:39 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Volume volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56 (4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56): created successfully Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40c804f-3006-4948-8fda-c3a76b31edbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Flow 'volume_create_manager' (32f1bac6-5c84-41b6-be16-7ad40caa63c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fb6dad-5dfa-4101-8194-a4dc604c6b00]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:40 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ab0cdb49-2873-4f91-8ff8-8d84d2e8ae0a tempest-TestInstancesWithCinderVolumes-824214854 None] Created volume successfully. Aug 26 16:20:40 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 Aug 26 16:20:40 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:40 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426" returned: 0 in 0.491s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e1d8e9-5598-4285-b317-ffe951f2fa35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:20:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:40 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 1G Aug 26 16:20:40 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:41 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 1G" returned: 0 in 0.634s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:41 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 Aug 26 16:20:41 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:41 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012" returned: 0 in 0.346s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:41 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 is being set with open permissions: ugo+rw Aug 26 16:20:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:41 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 Aug 26 16:20:41 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:41 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012" returned: 0 in 0.328s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:41 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-72004b5f-a12e-4609-93fb-5f604e150041 tempest-SnapshotsActionsTest-362247595 None] Create snapshot completed successfully Aug 26 16:20:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Acquiring lock "cinder-7b35a5ab-a6a4-422b-ade4-dec1cf636012-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-7b35a5ab-a6a4-422b-ade4-dec1cf636012-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Acquiring lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Acquiring lock "cinder-quobyte-7b35a5ab-a6a4-422b-ade4-dec1cf636012" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-7b35a5ab-a6a4-422b-ade4-dec1cf636012" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:43 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Deleting offline snapshot 7b35a5ab-a6a4-422b-ade4-dec1cf636012 of volume 83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:20:43 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] snapshot_file for this snap is: volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:20:43 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1719e1-0643-4ffe-82f0-93d7127ac695]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:43 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 Aug 26 16:20:43 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:43 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012" returned: 0 in 0.529s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:43 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e1d8e9-5598-4285-b317-ffe951f2fa35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:20:43 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa7bcd6-0d6e-4942-81d6-2d75de563dc9]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:43 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 Aug 26 16:20:43 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:44 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426" returned: 0 in 0.458s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e1d8e9-5598-4285-b317-ffe951f2fa35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:44 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 Aug 26 16:20:44 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD, size 20.69 MB, duration 4.49 sec {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 16:20:44 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Image download 20.69 MB at 4.61 MB/s Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3d56e0-55c5-4144-96b0-4ecbebadf420]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:44 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD Aug 26 16:20:44 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:44 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012" returned: 0 in 0.536s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:44 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Temporary image 9b7727e6-57fc-4e87-a22c-525ed57a4e4a is fetched for user 0c4592b9c324430db8cab99c3aab534d. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 16:20:44 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012 Aug 26 16:20:44 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be5e4f1-5948-4c73-aee9-e71ec6459c7b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:44 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD Aug 26 16:20:44 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:44 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.7b35a5ab-a6a4-422b-ade4-dec1cf636012" returned: 0 in 0.325s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-7b35a5ab-a6a4-422b-ade4-dec1cf636012" released by "_delete_snapshot" :: held 1.988s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" released by "delete_snapshot" :: held 2.021s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Created reservations ['710beffc-b108-4e02-967e-6e2b78c4b1e8', '3c7e357f-1df7-4f26-ac97-4468656fe05e', '23d1ff73-ce31-41c8-8c97-7daf36f05bce', '7de31440-5156-45fb-b6cd-f3b24ad5ee33'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:45 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1300095872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be84bd9-93d7-4f37-a357-5d5453331888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd80a9b50844e9d85c01a9df8fe3a0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:20:38Z,use_quota=True,user_id='0c4592b9c324430db8cab99c3aab534d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6076395-f75b-4b8c-8464-5f0fb1273737),volume_type_id=a6076395-f75b-4b8c-8464-5f0fb1273737)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Creating volume 1be84bd9-93d7-4f37-a357-5d5453331888 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:20:45 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:45 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 1073741824 Aug 26 16:20:45 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:45 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Delete snapshot completed successfully. Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2bc34428-3a91-4ccd-bc0a-f4317c018a07 tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-7b35a5ab-a6a4-422b-ade4-dec1cf636012-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:45 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 1073741824" returned: 0 in 0.582s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:46 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 Aug 26 16:20:46 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:46 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888" returned: 0 in 0.305s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Attempting download of 9b7727e6-57fc-4e87-a22c-525ed57a4e4a ((None, [{'url': 'file:///opt/stack/data/glance/images/9b7727e6-57fc-4e87-a22c-525ed57a4e4a', 'metadata': {}}])) to volume 1be84bd9-93d7-4f37-a357-5d5453331888. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07cc025-d380-454c-973a-cfd87b0a52d9]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_uw9bfunc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] Creating offline snapshot fc2c05a2-f813-4e6a-821b-6404caf2524e of volume 83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:20:46 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_uw9bfunc Aug 26 16:20:46 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[479a2b97-ab07-4ebb-b5a5-956a56e789e6]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:46 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 Aug 26 16:20:46 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Flow 'volume_create_manager' (f02cdc1b-b71d-4867-a064-ad243417aa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee2541d-2c85-4391-87ee-7c78ac457562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:46 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee2541d-2c85-4391-87ee-7c78ac457562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-788152578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9b9c97-c94c-41ba-87cd-6bbf6e738414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2aa40c2b854f5cabf6221f16ee02ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:20:47Z,use_quota=True,user_id='23c4fdc6734d462bb222fde2ecc5517b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1979b83-ec20-4d5a-a1c0-d5f0e3893211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1979b83-ec20-4d5a-a1c0-d5f0e3893211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5868f735-f59a-4031-a2a4-7c81cf467c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5868f735-f59a-4031-a2a4-7c81cf467c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab9b9c97-c94c-41ba-87cd-6bbf6e738414', 'volume_name': 'volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7b070e-8867-450c-91f4-dc5b57dd261e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7b070e-8867-450c-91f4-dc5b57dd261e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dc9ad5-a15e-4af7-a2ac-5dab52c5eba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:47 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Volume ab9b9c97-c94c-41ba-87cd-6bbf6e738414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414', 'volume_size': 1} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_uw9bfunc" returned: 0 in 0.485s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_uw9bfunc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:47 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_uw9bfunc Aug 26 16:20:47 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:47 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426" returned: 0 in 0.513s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e1d8e9-5598-4285-b317-ffe951f2fa35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:47 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e 1G Aug 26 16:20:47 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:47 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_uw9bfunc" returned: 1 in 0.415s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_uw9bfunc' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ccde9d-b8a2-49c7-bdfc-1d15afe0f0e6]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:47 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD Aug 26 16:20:47 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:47 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] 9b7727e6-57fc-4e87-a22c-525ed57a4e4a was qcow2, converting to qcow2 {{(pid=94407) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:47 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e 1G" returned: 0 in 0.523s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:47 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 Aug 26 16:20:47 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:47 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e Aug 26 16:20:47 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:48 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e" returned: 0 in 0.347s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:48 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e is being set with open permissions: ugo+rw Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:48 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e Aug 26 16:20:48 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:48 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e" returned: 0 in 0.253s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.452s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-788152578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9b9c97-c94c-41ba-87cd-6bbf6e738414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2aa40c2b854f5cabf6221f16ee02ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:20:47Z,use_quota=True,user_id='23c4fdc6734d462bb222fde2ecc5517b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Creating volume ab9b9c97-c94c-41ba-87cd-6bbf6e738414 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:20:48 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:48 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414 1073741824 Aug 26 16:20:48 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:48 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-acefa813-b7d7-4ce9-9818-7448651159b6 tempest-SnapshotsActionsTest-362247595 None] Create snapshot completed successfully Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Acquiring lock "cinder-fc2c05a2-f813-4e6a-821b-6404caf2524e-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-fc2c05a2-f813-4e6a-821b-6404caf2524e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Acquiring lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Acquiring lock "cinder-quobyte-fc2c05a2-f813-4e6a-821b-6404caf2524e" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-fc2c05a2-f813-4e6a-821b-6404caf2524e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Deleting offline snapshot fc2c05a2-f813-4e6a-821b-6404caf2524e of volume 83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] snapshot_file for this snap is: volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[80acffa8-8570-46cf-82c5-2d637cd4c116]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:49 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414 1073741824" returned: 0 in 0.636s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:49 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e Aug 26 16:20:49 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:49 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414 Aug 26 16:20:49 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:49 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e" returned: 0 in 0.442s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e1d8e9-5598-4285-b317-ffe951f2fa35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[995e9ef5-b5be-41a3-bbb9-2de581c203f2]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:49 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414" returned: 0 in 0.401s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dc9ad5-a15e-4af7-a2ac-5dab52c5eba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5472cc2d-e842-4335-9581-62fd79c44962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:49 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Volume volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414 (ab9b9c97-c94c-41ba-87cd-6bbf6e738414): created successfully Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5472cc2d-e842-4335-9581-62fd79c44962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Flow 'volume_create_manager' (f02cdc1b-b71d-4867-a064-ad243417aa0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:20:49 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0129f7af-d7b2-47fb-a10a-f6114a4d0d5a tempest-VolumesServicesTestJSON-1456570414 None] Created volume successfully. Aug 26 16:20:49 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 Aug 26 16:20:49 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:49 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888" returned: 0 in 2.180s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9b7727e6-57fc-4e87-a22c-525ed57a4e4a_h6vznk4fdevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:20:50 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Converted 112.00 MB image at 51.35 MB/s Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:50 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:50 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 1G Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426" returned: 0 in 0.473s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:50 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e1d8e9-5598-4285-b317-ffe951f2fa35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:50 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e Aug 26 16:20:50 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Acquiring lock "cinder-ab9b9c97-c94c-41ba-87cd-6bbf6e738414-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Lock "cinder-ab9b9c97-c94c-41ba-87cd-6bbf6e738414-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Acquiring lock "cinder-quobyte-ab9b9c97-c94c-41ba-87cd-6bbf6e738414" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Lock "cinder-quobyte-ab9b9c97-c94c-41ba-87cd-6bbf6e738414" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e30a5f-46f7-4404-bdab-0e141fbe5a04]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:50 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 1G" returned: 0 in 0.523s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Downloaded image 9b7727e6-57fc-4e87-a22c-525ed57a4e4a ((None, [{'url': 'file:///opt/stack/data/glance/images/9b7727e6-57fc-4e87-a22c-525ed57a4e4a', 'metadata': {}}])) to volume 1be84bd9-93d7-4f37-a357-5d5453331888 successfully. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Temporary image 9b7727e6-57fc-4e87-a22c-525ed57a4e4a for user 0c4592b9c324430db8cab99c3aab534d is deleted. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Marking volume 1be84bd9-93d7-4f37-a357-5d5453331888 as bootable. {{(pid=94407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 16:20:50 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414 Aug 26 16:20:50 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Copying metadata from image 9b7727e6-57fc-4e87-a22c-525ed57a4e4a to 1be84bd9-93d7-4f37-a357-5d5453331888. {{(pid=94407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Creating volume glance metadata for volume 1be84bd9-93d7-4f37-a357-5d5453331888 backed by image 9b7727e6-57fc-4e87-a22c-525ed57a4e4a with: {'image_id': '9b7727e6-57fc-4e87-a22c-525ed57a4e4a', 'image_name': 'tempest-scenario-img--637251734', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 16:20:50 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e" returned: 0 in 0.580s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aae2c6d-bc4c-4c6d-8f99-836b29f877b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be84bd9-93d7-4f37-a357-5d5453331888', 'volume_size': 1, 'image_id': '9b7727e6-57fc-4e87-a22c-525ed57a4e4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b7727e6-57fc-4e87-a22c-525ed57a4e4a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--637251734', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cfd80a9b50844e9d85c01a9df8fe3a0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9b7727e6-57fc-4e87-a22c-525ed57a4e4a', 'created_at': datetime.datetime(2026, 8, 26, 14, 20, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 20, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b7727e6-57fc-4e87-a22c-525ed57a4e4a/file', 'properties': {}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e77dfe-5bf6-49ac-8a5f-08bf30b1e99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:20:50 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e Aug 26 16:20:50 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:50 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Volume volume-1be84bd9-93d7-4f37-a357-5d5453331888 (1be84bd9-93d7-4f37-a357-5d5453331888): created successfully Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e77dfe-5bf6-49ac-8a5f-08bf30b1e99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Flow 'volume_create_manager' (08e9a30d-4522-488f-94c4-a71e9d9e90fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:20:50 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5804c0f3-4e5a-4176-9c9e-e9ee1b3da337 tempest-TestInstancesWithCinderVolumes-824214854 None] Created volume successfully. Aug 26 16:20:50 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414" returned: 0 in 0.439s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:50 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414 Aug 26 16:20:50 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:50 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.fc2c05a2-f813-4e6a-821b-6404caf2524e" returned: 0 in 0.303s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-fc2c05a2-f813-4e6a-821b-6404caf2524e" released by "_delete_snapshot" :: held 1.947s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" released by "delete_snapshot" :: held 1.975s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Created reservations ['883fbaf0-150d-4ada-8a2b-13c242251b87', 'e726c465-342f-4825-bd25-aed8a33ab537', '7f1e61ad-ed8a-4890-8dae-082ba852c2ae', 'f4b5b597-08b0-414f-be28-76eddace31bc'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:51 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab9b9c97-c94c-41ba-87cd-6bbf6e738414" returned: 0 in 0.274s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Delete snapshot completed successfully. Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Lock "cinder-quobyte-ab9b9c97-c94c-41ba-87cd-6bbf6e738414" released by "delete_volume" :: held 0.771s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-174db1e7-a49a-4dd8-b057-5439c272087c tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-fc2c05a2-f813-4e6a-821b-6404caf2524e-delete_snapshot" released by "delete_snapshot" :: held 2.176s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Created reservations ['93798da7-e48b-4822-a1fe-d781bf51767d', 'c67cd211-cd8c-404d-b495-4e069294065c', 'c4040db1-4833-454b-ab09-ced11aa3c8b1', 'fca94a06-d925-40a2-963f-79e772ecbc58'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:51 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:20:51 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:51 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.266s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:20:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Deleted volume successfully. Aug 26 16:20:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2e14ffb0-64e6-45a0-93c5-ee993b5d734f tempest-VolumesServicesTestJSON-1456570414 None] Lock "cinder-ab9b9c97-c94c-41ba-87cd-6bbf6e738414-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:52 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] Creating offline snapshot a20cd1a9-10ba-4fd5-ae8a-65300ecc052a of volume 83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:20:52 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[45efb3a2-d85d-4269-9b79-8e4c4257be5f]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:53 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 Aug 26 16:20:53 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:53 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426" returned: 0 in 0.505s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:53 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e1d8e9-5598-4285-b317-ffe951f2fa35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:20:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:53 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a 1G Aug 26 16:20:53 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:54 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a 1G" returned: 0 in 0.724s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:54 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a Aug 26 16:20:54 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:54 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a" returned: 0 in 0.532s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:54 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a is being set with open permissions: ugo+rw Aug 26 16:20:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:54 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a Aug 26 16:20:54 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:55 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a" returned: 0 in 0.394s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.331s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7d9b5c4a-dd31-4239-8881-10125dea82b2 tempest-SnapshotsActionsTest-362247595 None] Create snapshot completed successfully Aug 26 16:20:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-6a5cbd61-61a4-44f7-933f-00eb1064ae61 req-ddfa695c-38d5-4f65-a473-405e1b6507d1 tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:20:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-6a5cbd61-61a4-44f7-933f-00eb1064ae61 req-ddfa695c-38d5-4f65-a473-405e1b6507d1 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:20:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-6a5cbd61-61a4-44f7-933f-00eb1064ae61 req-ddfa695c-38d5-4f65-a473-405e1b6507d1 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:20:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-6a5cbd61-61a4-44f7-933f-00eb1064ae61 req-ddfa695c-38d5-4f65-a473-405e1b6507d1 tempest-TestInstancesWithCinderVolumes-824214854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-1be84bd9-93d7-4f37-a357-5d5453331888', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5131e6b6-ff35-4dd0-8b23-a87c4534b392', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:20:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-6a5cbd61-61a4-44f7-933f-00eb1064ae61 req-ddfa695c-38d5-4f65-a473-405e1b6507d1 tempest-TestInstancesWithCinderVolumes-824214854 None] attachment_update completed successfully. Aug 26 16:20:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Acquiring lock "cinder-a20cd1a9-10ba-4fd5-ae8a-65300ecc052a-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-a20cd1a9-10ba-4fd5-ae8a-65300ecc052a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Acquiring lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" acquired by "delete_snapshot" :: waited 0.045s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Acquiring lock "cinder-quobyte-a20cd1a9-10ba-4fd5-ae8a-65300ecc052a" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:20:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-a20cd1a9-10ba-4fd5-ae8a-65300ecc052a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:20:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Deleting offline snapshot a20cd1a9-10ba-4fd5-ae8a-65300ecc052a of volume 83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:20:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] snapshot_file for this snap is: volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:20:56 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6280103-4910-4afe-8471-0726cdf6998e]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:56 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a Aug 26 16:20:56 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:57 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a" returned: 0 in 0.521s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e1d8e9-5598-4285-b317-ffe951f2fa35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:20:57 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff46f03-45bb-4130-bc4a-626027b8347f]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:20:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:57 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 Aug 26 16:20:57 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:57 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426" returned: 0 in 0.575s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e1d8e9-5598-4285-b317-ffe951f2fa35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:20:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:57 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a Aug 26 16:20:57 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:58 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a" returned: 0 in 0.518s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:20:58 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a Aug 26 16:20:58 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:20:58 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Aug 26 16:20:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.a20cd1a9-10ba-4fd5-ae8a-65300ecc052a" returned: 0 in 0.327s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:20:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-a20cd1a9-10ba-4fd5-ae8a-65300ecc052a" released by "_delete_snapshot" :: held 2.132s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" released by "delete_snapshot" :: held 2.173s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:20:58 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Created reservations ['563305ee-bf69-4fde-a232-a3608f86c48c', 'a3bf1f33-ce9e-4bfa-852e-0365af5ecc2f', '453a8d7b-0757-490f-98d5-4f9bbadbb4de', '92f198b1-7adb-48c0-b754-a8924bdc1af9'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:20:58 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Delete snapshot completed successfully. Aug 26 16:20:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f91266ce-1a27-4edd-884e-22a6c8b1893c tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-a20cd1a9-10ba-4fd5-ae8a-65300ecc052a-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Flow 'volume_create_manager' (1c660241-3e9f-4179-932f-47b1e7c58ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a7eb58-23e8-4c71-b0a1-e6e246f0dfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a7eb58-23e8-4c71-b0a1-e6e246f0dfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-95679745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d150dd-ee1a-4723-a30b-374fcd064171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693f0083425c4768bd446cc00ad79bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:21:00Z,use_quota=True,user_id='7ad93bfb37f041e8a9e90b94f528a75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0ca970-834f-4a38-9020-1bb946f86357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0ca970-834f-4a38-9020-1bb946f86357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27cd4c1-9df6-443a-960e-58cf2eed6219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27cd4c1-9df6-443a-960e-58cf2eed6219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d150dd-ee1a-4723-a30b-374fcd064171', 'volume_name': 'volume-90d150dd-ee1a-4723-a30b-374fcd064171', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b842a85-0efb-4f61-a988-ace0af03389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b842a85-0efb-4f61-a988-ace0af03389f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c25ec94-de4c-4f5c-8650-c52694691af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:00 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Volume 90d150dd-ee1a-4723-a30b-374fcd064171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d150dd-ee1a-4723-a30b-374fcd064171', 'volume_size': 1} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-95679745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d150dd-ee1a-4723-a30b-374fcd064171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='693f0083425c4768bd446cc00ad79bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:21:00Z,use_quota=True,user_id='7ad93bfb37f041e8a9e90b94f528a75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Creating volume 90d150dd-ee1a-4723-a30b-374fcd064171 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:21:00 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:00 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171 1073741824 Aug 26 16:21:00 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:01 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171 1073741824" returned: 0 in 0.794s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:01 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171 Aug 26 16:21:01 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:01 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171" returned: 0 in 0.278s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:21:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.937s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c25ec94-de4c-4f5c-8650-c52694691af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d150dd-ee1a-4723-a30b-374fcd064171', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf01441a-7e47-443c-8333-343ea6390998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] Creating offline snapshot 778608b5-a32a-4351-b1d4-ef85de109739 of volume 83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:21:01 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Volume volume-90d150dd-ee1a-4723-a30b-374fcd064171 (90d150dd-ee1a-4723-a30b-374fcd064171): created successfully Aug 26 16:21:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf01441a-7e47-443c-8333-343ea6390998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Flow 'volume_create_manager' (1c660241-3e9f-4179-932f-47b1e7c58ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:21:01 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b182af32-39ed-4f79-8076-05a478129ca6]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c8fb908b-b651-4fc6-85a0-6a6a3f1b7994 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Created volume successfully. Aug 26 16:21:01 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 Aug 26 16:21:01 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:02 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426" returned: 0 in 0.476s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e1d8e9-5598-4285-b317-ffe951f2fa35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:21:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:02 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 1G Aug 26 16:21:02 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:03 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 1G" returned: 0 in 1.132s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:03 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 Aug 26 16:21:03 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:03 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739" returned: 0 in 0.458s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:03 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 is being set with open permissions: ugo+rw Aug 26 16:21:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:03 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 Aug 26 16:21:03 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:04 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739" returned: 0 in 0.478s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.191s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Creating offline snapshot ea2e9289-74c9-4dbd-805a-65c9c6785a18 of volume 90d150dd-ee1a-4723-a30b-374fcd064171 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:21:04 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-960dca2b-fae3-42c5-8073-9ddb3aaccb2e tempest-SnapshotsActionsTest-362247595 None] Create snapshot completed successfully Aug 26 16:21:04 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4842d3-c2b2-458e-ab7b-ce7a54970880]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:04 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171 Aug 26 16:21:04 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:05 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171" returned: 0 in 0.736s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Acquiring lock "cinder-778608b5-a32a-4351-b1d4-ef85de109739-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:05 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 1G Aug 26 16:21:05 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-778608b5-a32a-4351-b1d4-ef85de109739-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Acquiring lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Acquiring lock "cinder-quobyte-778608b5-a32a-4351-b1d4-ef85de109739" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-778608b5-a32a-4351-b1d4-ef85de109739" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Deleting offline snapshot 778608b5-a32a-4351-b1d4-ef85de109739 of volume 83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] snapshot_file for this snap is: volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a21d84-30d0-41f5-9858-539f5bfa3d59]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:05 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 Aug 26 16:21:05 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:05 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 1G" returned: 0 in 0.745s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90d150dd-ee1a-4723-a30b-374fcd064171 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:05 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90d150dd-ee1a-4723-a30b-374fcd064171 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 Aug 26 16:21:05 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:06 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739" returned: 0 in 0.865s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e1d8e9-5598-4285-b317-ffe951f2fa35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:21:06 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47d30a1-4446-4801-8b5c-4ed945d677d1]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:06 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90d150dd-ee1a-4723-a30b-374fcd064171 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18" returned: 0 in 0.634s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:06 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 is being set with open permissions: ugo+rw Aug 26 16:21:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:06 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 Aug 26 16:21:06 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:06 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 Aug 26 16:21:06 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:06 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18" returned: 0 in 0.404s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:07 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.info Aug 26 16:21:07 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:07 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426" returned: 0 in 0.737s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e1d8e9-5598-4285-b317-ffe951f2fa35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:21:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:07 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 Aug 26 16:21:07 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:07 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.info" returned: 0 in 0.463s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:07 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.info is being set with open permissions: ugo+rw Aug 26 16:21:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:07 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.info Aug 26 16:21:07 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739" returned: 0 in 0.757s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:07 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:07 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739 Aug 26 16:21:07 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:08 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.info" returned: 0 in 0.613s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.863s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-af5f7a3e-3334-4c07-85ea-a88f60a026c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Create snapshot completed successfully Aug 26 16:21:08 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.778608b5-a32a-4351-b1d4-ef85de109739" returned: 0 in 0.422s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-778608b5-a32a-4351-b1d4-ef85de109739" released by "_delete_snapshot" :: held 3.028s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" released by "delete_snapshot" :: held 3.075s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:08 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Created reservations ['9d4f3ada-a167-45f0-90ee-77627468b204', 'ed1f8fcf-d50e-434e-8f68-d81b85d808dc', 'dca9e122-b17d-4ad8-a443-b156e8945fee', 'dc7f513f-f741-4384-9531-0e89afa1170d'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:21:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Delete snapshot completed successfully. Aug 26 16:21:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-31d43a59-ebfb-43db-99b4-25a7d1ebfe59 tempest-SnapshotsActionsTest-2041181007 None] Lock "cinder-778608b5-a32a-4351-b1d4-ef85de109739-delete_snapshot" released by "delete_snapshot" :: held 3.342s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Acquiring lock "cinder-ea2e9289-74c9-4dbd-805a-65c9c6785a18-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "cinder-ea2e9289-74c9-4dbd-805a-65c9c6785a18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Acquiring lock "cinder-quobyte-90d150dd-ee1a-4723-a30b-374fcd064171" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "cinder-quobyte-90d150dd-ee1a-4723-a30b-374fcd064171" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Acquiring lock "cinder-quobyte-ea2e9289-74c9-4dbd-805a-65c9c6785a18" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "cinder-quobyte-ea2e9289-74c9-4dbd-805a-65c9c6785a18" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Deleting offline snapshot ea2e9289-74c9-4dbd-805a-65c9c6785a18 of volume 90d150dd-ee1a-4723-a30b-374fcd064171 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:21:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] snapshot_file for this snap is: volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:21:09 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[6169bb91-678b-4e4f-b4c7-a9737b80e875]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:09 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 Aug 26 16:21:09 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:10 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18" returned: 0 in 0.612s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90d150dd-ee1a-4723-a30b-374fcd064171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[9461e79d-91d1-4b98-b9ff-cb9a679ec2b4]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:10 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171 Aug 26 16:21:10 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Acquiring lock "cinder-51940629-59ca-4a75-b1f0-f21cacc5f426-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Lock "cinder-51940629-59ca-4a75-b1f0-f21cacc5f426-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Acquiring lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Acquiring lock "cinder-quobyte-51940629-59ca-4a75-b1f0-f21cacc5f426" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Lock "cinder-quobyte-51940629-59ca-4a75-b1f0-f21cacc5f426" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Deleting offline snapshot 51940629-59ca-4a75-b1f0-f21cacc5f426 of volume 83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] snapshot_file for this snap is: volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[698a25d0-51cf-41e1-bf32-7071259ece1c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:10 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 Aug 26 16:21:10 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:10 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171" returned: 0 in 0.550s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:10 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 Aug 26 16:21:10 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:11 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426" returned: 0 in 0.850s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e1d8e9-5598-4285-b317-ffe951f2fa35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:21:11 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccced6d8-14d1-4655-acc4-0821dc4d16f7]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:11 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18" returned: 0 in 0.731s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:11 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18 Aug 26 16:21:11 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:11 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 Aug 26 16:21:11 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171.ea2e9289-74c9-4dbd-805a-65c9c6785a18" returned: 0 in 0.426s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:11 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "cinder-quobyte-ea2e9289-74c9-4dbd-805a-65c9c6785a18" released by "_delete_snapshot" :: held 2.517s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "cinder-quobyte-90d150dd-ee1a-4723-a30b-374fcd064171" released by "delete_snapshot" :: held 2.550s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:12 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Created reservations ['77a51b18-c75e-44b9-b182-f158f6a3eaa9', '14bb4636-17bc-4b35-b1d5-499712707b42', 'e4d564ae-b496-4941-a0ec-b235fbc254e5', '5789efe3-4344-446e-a56f-e3f30cf74a36'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:21:12 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35" returned: 0 in 0.841s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:12 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Delete snapshot completed successfully. Aug 26 16:21:12 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 Aug 26 16:21:12 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-207a3bbb-cd1e-430f-8fc5-b069409d9167 tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "cinder-ea2e9289-74c9-4dbd-805a-65c9c6785a18-delete_snapshot" released by "delete_snapshot" :: held 2.916s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Acquiring lock "cinder-90d150dd-ee1a-4723-a30b-374fcd064171-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "cinder-90d150dd-ee1a-4723-a30b-374fcd064171-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Acquiring lock "cinder-quobyte-90d150dd-ee1a-4723-a30b-374fcd064171" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:13 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426" returned: 0 in 0.843s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "cinder-quobyte-90d150dd-ee1a-4723-a30b-374fcd064171" acquired by "delete_volume" :: waited 0.074s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:13 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426 Aug 26 16:21:13 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:13 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aefc4f-858c-4498-9741-5ed5ac49380c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:13 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171 Aug 26 16:21:13 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:13 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35.51940629-59ca-4a75-b1f0-f21cacc5f426" returned: 0 in 0.401s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Lock "cinder-quobyte-51940629-59ca-4a75-b1f0-f21cacc5f426" released by "_delete_snapshot" :: held 3.137s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" released by "delete_snapshot" :: held 3.179s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:13 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Created reservations ['12d9d246-5357-4286-8a76-4f776319ee24', '0712f5ed-c4b7-4edd-8579-d698c80dd155', '07650a72-ae4b-48b2-8e23-c3601b28f759', 'f9362629-c3f2-4a6c-85dc-8c164e64405d'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:21:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Delete snapshot completed successfully. Aug 26 16:21:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-03647504-6b7c-4570-bf64-8a35dbe65dbf tempest-SnapshotsActionsTest-362247595 None] Lock "cinder-51940629-59ca-4a75-b1f0-f21cacc5f426-delete_snapshot" released by "delete_snapshot" :: held 3.396s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:13 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171" returned: 0 in 0.725s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:14 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171 Aug 26 16:21:14 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:14 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90d150dd-ee1a-4723-a30b-374fcd064171" returned: 0 in 0.438s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "cinder-quobyte-90d150dd-ee1a-4723-a30b-374fcd064171" released by "delete_volume" :: held 1.319s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:14 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Created reservations ['bf385170-7760-4e79-a8e7-188a0f732dbb', 'bef92988-3ccb-49c2-bc32-58a86555199c', '86fd5433-77f2-4bec-a985-c84407da45ac', '5de61faa-3068-41bf-95d1-0d62a85801e6'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:21:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:14 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:21:14 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Acquiring lock "cinder-83e1d8e9-5598-4285-b317-ffe951f2fa35-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Lock "cinder-83e1d8e9-5598-4285-b317-ffe951f2fa35-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Acquiring lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" acquired by "delete_volume" :: waited 0.031s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:15 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f121b-915d-4958-9721-b8d8572cfe99]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:15 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.485s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:15 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:21:15 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Deleted volume successfully. Aug 26 16:21:15 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 Aug 26 16:21:15 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d0c1fa65-e8e8-4dbf-8d5a-042c3667bf3e tempest-VolumeSnapshotQuotasNegativeTestJSON-1018072247 None] Lock "cinder-90d150dd-ee1a-4723-a30b-374fcd064171-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:15 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35" returned: 0 in 0.475s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:15 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35 Aug 26 16:21:15 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:15 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-83e1d8e9-5598-4285-b317-ffe951f2fa35" returned: 0 in 0.418s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Lock "cinder-quobyte-83e1d8e9-5598-4285-b317-ffe951f2fa35" released by "delete_volume" :: held 1.018s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:16 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Created reservations ['a87342f0-5cb4-4c30-8ed8-271f3498de6f', '23419319-6d2a-46b7-8db6-8928b97cf813', '9d37bf2d-f934-4923-bb53-ddf24391d580', '93cb0725-351a-446c-9b90-45bd40d4c8e2'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:21:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:16 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:21:16 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:16 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.323s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:16 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:21:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Deleted volume successfully. Aug 26 16:21:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2a2304e5-9b39-41cc-99fb-72f6792c98c0 tempest-SnapshotsActionsTest-362247595 None] Lock "cinder-83e1d8e9-5598-4285-b317-ffe951f2fa35-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:21:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:18 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:21:18 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Flow 'volume_create_manager' (c49f97ca-de4b-49ff-992a-f8943b99a805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6305bce-d4d4-4a67-b31a-18dd30728827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6305bce-d4d4-4a67-b31a-18dd30728827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2036209773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3d7edf-1e07-4eec-92a6-647fca84f38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b853a847479447facfe7336cdda5f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:21:18Z,use_quota=True,user_id='cc0072e607b14b0ba229eafa870a40cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3a4974-7eb0-4670-9362-90075186db82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3a4974-7eb0-4670-9362-90075186db82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208e6bcb-82a3-4d9d-bf03-90a36e4942ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.image.glance [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Creating Keystone auth plugin from conf {{(pid=94407) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 16:21:18 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.618s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 28 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208e6bcb-82a3-4d9d-bf03-90a36e4942ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f3d7edf-1e07-4eec-92a6-647fca84f38e', 'volume_name': 'volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd16ceb3-a25f-4091-b8aa-f21894e5ca25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd16ceb3-a25f-4091-b8aa-f21894e5ca25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:19 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02313e04-8e18-4885-b02a-a88169f8f8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:19 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Volume 1f3d7edf-1e07-4eec-92a6-647fca84f38e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 16:21:19 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Trying to clone 1f3d7edf-1e07-4eec-92a6-647fca84f38e from image 6ac3a618-4ad2-4833-9626-12a425ebacfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]). {{(pid=94407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 16:21:19 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 16:21:19 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Image download 20.69 MB at 20.69 MB/s Aug 26 16:21:19 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e49b8d-8ee1-4627-8090-ca81c44ffc03]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:19 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD Aug 26 16:21:19 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:20 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Temporary image 6ac3a618-4ad2-4833-9626-12a425ebacfd is fetched for user cc0072e607b14b0ba229eafa870a40cb. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99da23d-e886-4162-bda6-e288fa725e63]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:20 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD Aug 26 16:21:20 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:20 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2036209773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3d7edf-1e07-4eec-92a6-647fca84f38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b853a847479447facfe7336cdda5f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:21:18Z,use_quota=True,user_id='cc0072e607b14b0ba229eafa870a40cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Creating volume 1f3d7edf-1e07-4eec-92a6-647fca84f38e {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:21:20 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:21:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:20 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e 1073741824 Aug 26 16:21:20 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:21 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e 1073741824" returned: 0 in 0.510s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:21 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e Aug 26 16:21:21 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:21 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e" returned: 0 in 0.265s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:21:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:21 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Attempting download of 6ac3a618-4ad2-4833-9626-12a425ebacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}])) to volume 1f3d7edf-1e07-4eec-92a6-647fca84f38e. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 16:21:21 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda15f00-3355-4c4a-baa9-921ff2fcf4ad]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_dgjf0_rx {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:21 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_dgjf0_rx Aug 26 16:21:21 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:21 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_dgjf0_rx" returned: 0 in 0.355s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_dgjf0_rx {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:22 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_dgjf0_rx Aug 26 16:21:22 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:22 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_dgjf0_rx" returned: 1 in 0.404s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_dgjf0_rx' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:21:22 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[60db101b-5283-4457-80e4-6332c24ab9f9]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:22 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD Aug 26 16:21:22 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:22 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:22 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] 6ac3a618-4ad2-4833-9626-12a425ebacfd was qcow2, converting to qcow2 {{(pid=94407) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 16:21:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:22 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e Aug 26 16:21:22 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=119,cinder:SELECT=112,cinder:INSERT=34,cinder:DELETE=8 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Flow 'volume_create_manager' (5593c6c1-a6e0-4540-80c8-2539e39769de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de95316-fe70-4cee-aa8f-f2998257111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de95316-fe70-4cee-aa8f-f2998257111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-964130179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768177fe-3952-45ab-952a-6766727c04a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c916bb1299644f56858c5ba2d7f82814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:21:24Z,use_quota=True,user_id='e8f1e3752816453ba761b7370d622f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43422ebb-840e-4c39-a4cd-fd0a210cc7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43422ebb-840e-4c39-a4cd-fd0a210cc7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ab377d-2ba4-43b3-a102-768418d0be5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ab377d-2ba4-43b3-a102-768418d0be5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768177fe-3952-45ab-952a-6766727c04a5', 'volume_name': 'volume-768177fe-3952-45ab-952a-6766727c04a5', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34540a78-3950-4d59-9b29-7d4688e992fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34540a78-3950-4d59-9b29-7d4688e992fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374a7f88-4617-48ca-9119-0eed1946617b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:24 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Volume 768177fe-3952-45ab-952a-6766727c04a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768177fe-3952-45ab-952a-6766727c04a5', 'volume_size': 1} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-964130179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768177fe-3952-45ab-952a-6766727c04a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c916bb1299644f56858c5ba2d7f82814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:21:24Z,use_quota=True,user_id='e8f1e3752816453ba761b7370d622f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Creating volume 768177fe-3952-45ab-952a-6766727c04a5 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:21:24 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-768177fe-3952-45ab-952a-6766727c04a5 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:24 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-768177fe-3952-45ab-952a-6766727c04a5 1073741824 Aug 26 16:21:24 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:24 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e" returned: 0 in 2.017s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_lzvgf7srdevstack@QuobyteHD, size 112.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:21:24 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Converted 112.00 MB image at 55.48 MB/s Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:24 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e 1G Aug 26 16:21:24 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:24 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-768177fe-3952-45ab-952a-6766727c04a5 1073741824" returned: 0 in 0.581s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-768177fe-3952-45ab-952a-6766727c04a5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:25 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-768177fe-3952-45ab-952a-6766727c04a5 Aug 26 16:21:25 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:25 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e 1G" returned: 0 in 0.365s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Downloaded image 6ac3a618-4ad2-4833-9626-12a425ebacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}])) to volume 1f3d7edf-1e07-4eec-92a6-647fca84f38e successfully. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Temporary image 6ac3a618-4ad2-4833-9626-12a425ebacfd for user cc0072e607b14b0ba229eafa870a40cb is deleted. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Marking volume 1f3d7edf-1e07-4eec-92a6-647fca84f38e as bootable. {{(pid=94407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Copying metadata from image 6ac3a618-4ad2-4833-9626-12a425ebacfd to 1f3d7edf-1e07-4eec-92a6-647fca84f38e. {{(pid=94407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Creating volume glance metadata for volume 1f3d7edf-1e07-4eec-92a6-647fca84f38e backed by image 6ac3a618-4ad2-4833-9626-12a425ebacfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02313e04-8e18-4885-b02a-a88169f8f8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ed32e7-139f-4c80-8013-423458c400bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:25 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-768177fe-3952-45ab-952a-6766727c04a5" returned: 0 in 0.284s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:25 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Volume volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e (1f3d7edf-1e07-4eec-92a6-647fca84f38e): created successfully Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ed32e7-139f-4c80-8013-423458c400bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Flow 'volume_create_manager' (c49f97ca-de4b-49ff-992a-f8943b99a805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374a7f88-4617-48ca-9119-0eed1946617b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768177fe-3952-45ab-952a-6766727c04a5', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f848051-e394-43c5-b6bf-0e8d53e93f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:25 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-294a91c6-01a2-47ab-b81a-7f35544aa5c8 tempest-TestShelveInstance-45300708 None] Created volume successfully. Aug 26 16:21:25 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Volume volume-768177fe-3952-45ab-952a-6766727c04a5 (768177fe-3952-45ab-952a-6766727c04a5): created successfully Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f848051-e394-43c5-b6bf-0e8d53e93f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Flow 'volume_create_manager' (5593c6c1-a6e0-4540-80c8-2539e39769de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:21:25 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-975aaffe-b8ed-469f-8d64-8aa2fabf3495 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Created volume successfully. Aug 26 16:21:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Acquiring lock "cinder-768177fe-3952-45ab-952a-6766727c04a5-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Lock "cinder-768177fe-3952-45ab-952a-6766727c04a5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Acquiring lock "cinder-quobyte-768177fe-3952-45ab-952a-6766727c04a5" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Lock "cinder-quobyte-768177fe-3952-45ab-952a-6766727c04a5" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:28 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb3078d-c6c3-4e42-9dbb-7e1ad7766fc3]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-768177fe-3952-45ab-952a-6766727c04a5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:28 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-768177fe-3952-45ab-952a-6766727c04a5 Aug 26 16:21:28 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:28 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-768177fe-3952-45ab-952a-6766727c04a5" returned: 0 in 0.512s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-768177fe-3952-45ab-952a-6766727c04a5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:28 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-768177fe-3952-45ab-952a-6766727c04a5 Aug 26 16:21:28 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:29 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-768177fe-3952-45ab-952a-6766727c04a5" returned: 0 in 0.580s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Lock "cinder-quobyte-768177fe-3952-45ab-952a-6766727c04a5" released by "delete_volume" :: held 1.164s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Created reservations ['2a075591-3f03-424b-ab82-ab71709a154f', 'bf054131-fbf4-4fd8-ac45-a4be9e40741d', '6d613253-aeb5-423d-834c-e819bd486ee5', '3b8531c6-8cba-4480-946e-2e717fccb437'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-74788b89-3ad2-4356-873c-17ec0a2c4e82 req-3b5cb0b0-4eb0-4d99-bf8a-36afa9a8aa48 tempest-TestShelveInstance-45300708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-74788b89-3ad2-4356-873c-17ec0a2c4e82 req-3b5cb0b0-4eb0-4d99-bf8a-36afa9a8aa48 tempest-TestShelveInstance-45300708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-74788b89-3ad2-4356-873c-17ec0a2c4e82 req-3b5cb0b0-4eb0-4d99-bf8a-36afa9a8aa48 tempest-TestShelveInstance-45300708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:29 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:21:29 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-74788b89-3ad2-4356-873c-17ec0a2c4e82 req-3b5cb0b0-4eb0-4d99-bf8a-36afa9a8aa48 tempest-TestShelveInstance-45300708 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '889cb028-099a-4854-acc2-b31e32452016', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:21:29 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-74788b89-3ad2-4356-873c-17ec0a2c4e82 req-3b5cb0b0-4eb0-4d99-bf8a-36afa9a8aa48 tempest-TestShelveInstance-45300708 None] attachment_update completed successfully. Aug 26 16:21:29 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.333s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:21:29 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Deleted volume successfully. Aug 26 16:21:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7bddcb40-9b04-4f4d-923b-f2f1d8182222 tempest-VolumeQuotasNegativeTestJSON-543135213 None] Lock "cinder-768177fe-3952-45ab-952a-6766727c04a5-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Flow 'volume_create_manager' (75caae52-e875-44b4-a0c6-9f9e5f39020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a039fd44-f8f6-451b-a84c-ae6dab13634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a039fd44-f8f6-451b-a84c-ae6dab13634c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-434879177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06851ed6-1824-45f7-9422-2bc9a19ca339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc1b68ff67e4e52b48ccfc70e2d5864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:21:31Z,use_quota=True,user_id='cd04ac74df544122b38e6be78e33cb05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6bad68-bf90-48a7-8afb-a2441d021cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6bad68-bf90-48a7-8afb-a2441d021cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15af3d03-1cde-4008-86b7-60786efc5c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15af3d03-1cde-4008-86b7-60786efc5c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06851ed6-1824-45f7-9422-2bc9a19ca339', 'volume_name': 'volume-06851ed6-1824-45f7-9422-2bc9a19ca339', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9aaec38-af6b-4289-a212-c2877c390e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9aaec38-af6b-4289-a212-c2877c390e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad56223-ea9f-457d-8820-ab2bc7a8c731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:31 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Volume 06851ed6-1824-45f7-9422-2bc9a19ca339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06851ed6-1824-45f7-9422-2bc9a19ca339', 'volume_size': 1} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-434879177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06851ed6-1824-45f7-9422-2bc9a19ca339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc1b68ff67e4e52b48ccfc70e2d5864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:21:31Z,use_quota=True,user_id='cd04ac74df544122b38e6be78e33cb05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Creating volume 06851ed6-1824-45f7-9422-2bc9a19ca339 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:21:31 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:31 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339 1073741824 Aug 26 16:21:31 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:31 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339 1073741824" returned: 0 in 0.554s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:31 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339 Aug 26 16:21:31 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:32 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339" returned: 0 in 0.281s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:21:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad56223-ea9f-457d-8820-ab2bc7a8c731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06851ed6-1824-45f7-9422-2bc9a19ca339', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ae46e4-d7b9-493b-aecd-d1394fbf5583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:32 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Volume volume-06851ed6-1824-45f7-9422-2bc9a19ca339 (06851ed6-1824-45f7-9422-2bc9a19ca339): created successfully Aug 26 16:21:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ae46e4-d7b9-493b-aecd-d1394fbf5583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Flow 'volume_create_manager' (75caae52-e875-44b4-a0c6-9f9e5f39020a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:21:32 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a43fd4ed-5a02-44f5-a845-0905a0e09b7b tempest-VolumesDeleteCascade-2061725170 None] Created volume successfully. Aug 26 16:21:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] Creating offline snapshot 45578410-03d4-497d-84bb-5f4b5a35a6e9 of volume 06851ed6-1824-45f7-9422-2bc9a19ca339 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:21:33 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[887cc1b7-11e9-4ea6-861e-b923b60586d3]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:34 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339 Aug 26 16:21:34 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-1744f71a-0057-43f4-9dcf-01ab5d0a3138 req-5dd0b998-b9e0-4653-9c29-e709c0770550 tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:34 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339" returned: 0 in 0.646s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:34 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 1G Aug 26 16:21:34 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:35 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 1G" returned: 0 in 0.461s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06851ed6-1824-45f7-9422-2bc9a19ca339 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:35 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06851ed6-1824-45f7-9422-2bc9a19ca339 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 Aug 26 16:21:35 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:35 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06851ed6-1824-45f7-9422-2bc9a19ca339 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9" returned: 0 in 0.417s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:35 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 is being set with open permissions: ugo+rw Aug 26 16:21:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:35 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 Aug 26 16:21:35 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:35 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9" returned: 0 in 0.462s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:36 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.info Aug 26 16:21:36 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:36 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.info" returned: 0 in 0.364s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:36 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.info is being set with open permissions: ugo+rw Aug 26 16:21:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:36 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.info Aug 26 16:21:36 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:36 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.info" returned: 0 in 0.270s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.769s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-1744f71a-0057-43f4-9dcf-01ab5d0a3138 req-5dd0b998-b9e0-4653-9c29-e709c0770550 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.258s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-1744f71a-0057-43f4-9dcf-01ab5d0a3138 req-5dd0b998-b9e0-4653-9c29-e709c0770550 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:36 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bc5f608d-2251-49f1-aa9a-383c09d5a385 tempest-VolumesDeleteCascade-2061725170 None] Create snapshot completed successfully Aug 26 16:21:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-1744f71a-0057-43f4-9dcf-01ab5d0a3138 req-5dd0b998-b9e0-4653-9c29-e709c0770550 tempest-TestInstancesWithCinderVolumes-824214854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '435debb8-d41d-4c5d-8842-350de20f1a3b', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:21:36 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-1744f71a-0057-43f4-9dcf-01ab5d0a3138 req-5dd0b998-b9e0-4653-9c29-e709c0770550 tempest-TestInstancesWithCinderVolumes-824214854 None] attachment_update completed successfully. Aug 26 16:21:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] Creating offline snapshot 26ced414-9a62-45a2-83f6-0e50d401fa40 of volume 06851ed6-1824-45f7-9422-2bc9a19ca339 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:21:37 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2615a4d6-86eb-4ae0-b699-f62530a3ae9c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:37 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 Aug 26 16:21:37 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:37 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9" returned: 0 in 0.565s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:38 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06851ed6-1824-45f7-9422-2bc9a19ca339(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:21:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:38 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 1G Aug 26 16:21:38 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:38 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 1G" returned: 0 in 0.774s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:38 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 Aug 26 16:21:38 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:39 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40" returned: 0 in 0.532s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:39 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 is being set with open permissions: ugo+rw Aug 26 16:21:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:39 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 Aug 26 16:21:39 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:39 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40" returned: 0 in 0.578s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:39 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=126,cinder:DELETE=10,cinder:UPDATE=106,cinder:INSERT=31 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:21:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:40 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-afe28737-39b8-46c5-b763-3ddc76b539a4 tempest-VolumesDeleteCascade-2061725170 None] Create snapshot completed successfully Aug 26 16:21:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-06851ed6-1824-45f7-9422-2bc9a19ca339-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-06851ed6-1824-45f7-9422-2bc9a19ca339-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Performing cascade delete. {{(pid=94407) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 16:21:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-26ced414-9a62-45a2-83f6-0e50d401fa40-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-26ced414-9a62-45a2-83f6-0e50d401fa40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-quobyte-06851ed6-1824-45f7-9422-2bc9a19ca339" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-06851ed6-1824-45f7-9422-2bc9a19ca339" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-quobyte-26ced414-9a62-45a2-83f6-0e50d401fa40" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-26ced414-9a62-45a2-83f6-0e50d401fa40" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Deleting offline snapshot 26ced414-9a62-45a2-83f6-0e50d401fa40 of volume 06851ed6-1824-45f7-9422-2bc9a19ca339 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:21:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] snapshot_file for this snap is: volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:21:40 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[089e15fb-3a54-4372-8b0c-cf2fe9ee6cba]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-aa232b39-2061-4d3d-b2dc-853921703381 req-22474b8a-7c6b-40c9-aaf2-04080d47a472 tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-aa232b39-2061-4d3d-b2dc-853921703381 req-22474b8a-7c6b-40c9-aaf2-04080d47a472 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-aa232b39-2061-4d3d-b2dc-853921703381 req-22474b8a-7c6b-40c9-aaf2-04080d47a472 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:41 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 Aug 26 16:21:41 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-aa232b39-2061-4d3d-b2dc-853921703381 req-22474b8a-7c6b-40c9-aaf2-04080d47a472 tempest-TestInstancesWithCinderVolumes-824214854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b419952-7ba2-47e7-a022-356899f372ca', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:21:41 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-aa232b39-2061-4d3d-b2dc-853921703381 req-22474b8a-7c6b-40c9-aaf2-04080d47a472 tempest-TestInstancesWithCinderVolumes-824214854 None] attachment_update completed successfully. Aug 26 16:21:41 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40" returned: 0 in 0.947s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06851ed6-1824-45f7-9422-2bc9a19ca339(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:21:42 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce80eee-a995-440d-b531-8e76714eb067]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:42 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 Aug 26 16:21:42 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:42 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9" returned: 0 in 0.703s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06851ed6-1824-45f7-9422-2bc9a19ca339(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:21:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:42 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 Aug 26 16:21:42 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:43 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40" returned: 0 in 0.585s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:43 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40 Aug 26 16:21:43 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:43 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.26ced414-9a62-45a2-83f6-0e50d401fa40" returned: 0 in 0.373s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-26ced414-9a62-45a2-83f6-0e50d401fa40" released by "_delete_snapshot" :: held 2.798s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-06851ed6-1824-45f7-9422-2bc9a19ca339" released by "delete_snapshot" :: held 2.842s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:43 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Created reservations ['7025df19-1a9c-45da-a26e-1a364516bb41', '29b82d95-13e2-4574-91f7-7e80799bf006', '021af8e9-7658-4b2f-8c54-feaa6a11c1a9', 'ca1d9a27-7039-45df-be5d-e20f620cfdc4'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:21:43 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Delete snapshot completed successfully. Aug 26 16:21:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-26ced414-9a62-45a2-83f6-0e50d401fa40-delete_snapshot" released by "delete_snapshot" :: held 3.082s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-45578410-03d4-497d-84bb-5f4b5a35a6e9-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-45578410-03d4-497d-84bb-5f4b5a35a6e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-quobyte-06851ed6-1824-45f7-9422-2bc9a19ca339" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-06851ed6-1824-45f7-9422-2bc9a19ca339" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-quobyte-45578410-03d4-497d-84bb-5f4b5a35a6e9" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-45578410-03d4-497d-84bb-5f4b5a35a6e9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Deleting offline snapshot 45578410-03d4-497d-84bb-5f4b5a35a6e9 of volume 06851ed6-1824-45f7-9422-2bc9a19ca339 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:21:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] snapshot_file for this snap is: volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:21:44 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4c32d4-6f22-47fe-9045-7ed4ec582f78]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:44 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 Aug 26 16:21:44 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:44 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9" returned: 0 in 0.547s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06851ed6-1824-45f7-9422-2bc9a19ca339(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:21:44 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21c289b-5546-4bb1-9bf5-0db2e6ae7a5c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:44 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339 Aug 26 16:21:44 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:45 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339" returned: 0 in 0.433s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:45 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 Aug 26 16:21:45 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:45 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9" returned: 0 in 0.450s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:45 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9 Aug 26 16:21:45 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:45 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339.45578410-03d4-497d-84bb-5f4b5a35a6e9" returned: 0 in 0.435s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-45578410-03d4-497d-84bb-5f4b5a35a6e9" released by "_delete_snapshot" :: held 2.011s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-06851ed6-1824-45f7-9422-2bc9a19ca339" released by "delete_snapshot" :: held 2.044s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:46 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Created reservations ['7e3b636b-4fbc-4e6f-aa23-11a0564f4830', 'bf21b638-89da-4394-a749-176307f92cad', '677f2807-17db-48de-9c02-4188441ba969', 'a9709dee-c856-4fc6-9f99-aab8c1fd9eca'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:21:46 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Delete snapshot completed successfully. Aug 26 16:21:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-45578410-03d4-497d-84bb-5f4b5a35a6e9-delete_snapshot" released by "delete_snapshot" :: held 2.295s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Snapshots deleted, issuing volume delete {{(pid=94407) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 16:21:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-quobyte-06851ed6-1824-45f7-9422-2bc9a19ca339" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-06851ed6-1824-45f7-9422-2bc9a19ca339" acquired by "delete_volume" :: waited 0.016s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:46 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac306261-9daa-4e13-8b59-874c99bef16f]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:46 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339 Aug 26 16:21:46 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:46 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339" returned: 0 in 0.434s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:46 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339 Aug 26 16:21:46 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:47 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-06851ed6-1824-45f7-9422-2bc9a19ca339" returned: 0 in 0.325s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-06851ed6-1824-45f7-9422-2bc9a19ca339" released by "delete_volume" :: held 0.837s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:47 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Created reservations ['b051ec72-6f52-4ae5-be2b-317eeb393900', '295f6b89-d1b6-4779-97d7-c229da3e2103', '7aca51ac-e73a-4de3-87b4-5887383995f3', '81a4a1b1-5b7e-440a-9d69-80a5e3a48baa'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:21:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:47 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:21:47 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:47 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.286s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:47 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:21:47 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Deleted volume successfully. Aug 26 16:21:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bf50fa73-c146-424d-be1c-42a814b6b45f tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-06851ed6-1824-45f7-9422-2bc9a19ca339-delete_volume" released by "delete_volume" :: held 6.907s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Flow 'volume_create_manager' (097c6f7c-8c3d-4c73-8ef5-e008abd8c1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca6f83a-154e-45fe-8733-b442f6029ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca6f83a-154e-45fe-8733-b442f6029ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1757177519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56ee3c7-80e3-4a41-b566-ebb3e4a4989a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc1b68ff67e4e52b48ccfc70e2d5864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:21:48Z,use_quota=True,user_id='cd04ac74df544122b38e6be78e33cb05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b32e665-28d6-4dff-83f6-d7f8e0ee2bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b32e665-28d6-4dff-83f6-d7f8e0ee2bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c56861-a12b-4d95-946a-6fcdf1a1348e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c56861-a12b-4d95-946a-6fcdf1a1348e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a56ee3c7-80e3-4a41-b566-ebb3e4a4989a', 'volume_name': 'volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a5b629-5f69-4536-99e5-05aef3a0db66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a5b629-5f69-4536-99e5-05aef3a0db66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92037a75-400a-4164-bd85-262e9585ddf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:48 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Volume a56ee3c7-80e3-4a41-b566-ebb3e4a4989a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a', 'volume_size': 1} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1757177519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56ee3c7-80e3-4a41-b566-ebb3e4a4989a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc1b68ff67e4e52b48ccfc70e2d5864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:21:48Z,use_quota=True,user_id='cd04ac74df544122b38e6be78e33cb05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Creating volume a56ee3c7-80e3-4a41-b566-ebb3e4a4989a {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:21:48 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:21:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:48 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a 1073741824 Aug 26 16:21:48 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:49 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-1ac44010-2e76-4a11-be31-40a79cbe6f98 req-65c29610-aba5-4e85-b2c4-57d1908bc971 tempest-TestInstancesWithCinderVolumes-824214854 None] Terminate volume connection completed successfully. Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-1ac44010-2e76-4a11-be31-40a79cbe6f98 req-65c29610-aba5-4e85-b2c4-57d1908bc971 tempest-TestInstancesWithCinderVolumes-824214854 None] Deleting attachment 435debb8-d41d-4c5d-8842-350de20f1a3b. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:21:49 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a 1073741824" returned: 0 in 0.694s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:49 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a Aug 26 16:21:49 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:49 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a" returned: 0 in 0.307s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92037a75-400a-4164-bd85-262e9585ddf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94b82f1-4f00-4bd9-9004-6091e93418ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "cinder-34e6f983-eed4-45e5-aa3f-8c2566e161c6-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:49 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Volume volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a (a56ee3c7-80e3-4a41-b566-ebb3e4a4989a): created successfully Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94b82f1-4f00-4bd9-9004-6091e93418ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Flow 'volume_create_manager' (097c6f7c-8c3d-4c73-8ef5-e008abd8c1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:21:49 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-40d780da-285f-4f3f-8a56-4b2ebcdb6523 tempest-VolumesDeleteCascade-2061725170 None] Created volume successfully. Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "cinder-34e6f983-eed4-45e5-aa3f-8c2566e161c6-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "cinder-quobyte-34e6f983-eed4-45e5-aa3f-8c2566e161c6" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "cinder-quobyte-34e6f983-eed4-45e5-aa3f-8c2566e161c6" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[564d78e9-c54f-4a6b-a353-0ae4a589ada2]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:49 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6 Aug 26 16:21:49 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:50 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6" returned: 0 in 0.444s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:50 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6 Aug 26 16:21:50 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] Creating offline snapshot b64d6309-710f-4116-bc35-b4ada5b26b02 of volume a56ee3c7-80e3-4a41-b566-ebb3e4a4989a {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:21:50 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-34e6f983-eed4-45e5-aa3f-8c2566e161c6" returned: 0 in 0.529s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "cinder-quobyte-34e6f983-eed4-45e5-aa3f-8c2566e161c6" released by "delete_volume" :: held 1.020s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a597b1f-9053-4aa8-9566-a4fc67ea0f22]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:50 devstack cinder-volume[94407]: WARNING cinder.quota [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1651446190-548649481 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1651446190-548649481, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:21:50 devstack cinder-volume[94407]: WARNING cinder.quota [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1651446190-548649481 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1651446190-548649481, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Created reservations ['f2618477-d706-41e8-aff7-1de232485b2b', '5b7b467a-71ea-4d02-84d0-6a2ad177c13c', '3f2695b5-c5fd-4084-948f-ea6ac6a8b839', '4ca88cea-76a4-45aa-a114-199f5266521d'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:51 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:21:51 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:51 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a Aug 26 16:21:51 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:51 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:51 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a" returned: 0 in 0.570s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.418s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:51 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:21:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Deleted volume successfully. Aug 26 16:21:51 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 1G Aug 26 16:21:51 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78d2b21e-56a9-4038-9c70-a36b1282e4a8 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "cinder-34e6f983-eed4-45e5-aa3f-8c2566e161c6-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:52 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 1G" returned: 0 in 0.727s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:52 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 Aug 26 16:21:52 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:52 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02" returned: 0 in 0.388s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:52 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 is being set with open permissions: ugo+rw Aug 26 16:21:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:52 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 Aug 26 16:21:52 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:52 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02" returned: 0 in 0.333s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:52 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.info Aug 26 16:21:52 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:53 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.info" returned: 0 in 0.362s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:53 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.info is being set with open permissions: ugo+rw Aug 26 16:21:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:53 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.info Aug 26 16:21:53 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:53 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.info" returned: 0 in 0.302s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.862s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:53 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-cd20cbb9-f7a3-4e9b-b5a6-a3ce4a525a47 tempest-VolumesDeleteCascade-2061725170 None] Create snapshot completed successfully Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Flow 'volume_create_manager' (d26c1143-69f0-4055-a98a-88f3aa1585b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0786472-bab4-4cdf-9cc2-87a79ea0a270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0786472-bab4-4cdf-9cc2-87a79ea0a270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-577175837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602a2bac-3680-4932-90bf-94baad272bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc1b68ff67e4e52b48ccfc70e2d5864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b64d6309-710f-4116-bc35-b4ada5b26b02,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:21:55Z,use_quota=True,user_id='cd04ac74df544122b38e6be78e33cb05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b6fc20-8ae2-44a3-9faf-0b3e6b9c8a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b6fc20-8ae2-44a3-9faf-0b3e6b9c8a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f3353a-eaec-4282-9325-cb368a1443e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f3353a-eaec-4282-9325-cb368a1443e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '602a2bac-3680-4932-90bf-94baad272bf4', 'volume_name': 'volume-602a2bac-3680-4932-90bf-94baad272bf4', 'volume_size': 1, 'snapshot_id': 'b64d6309-710f-4116-bc35-b4ada5b26b02'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18474b13-276e-446a-a91d-a939e13fdd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18474b13-276e-446a-a91d-a939e13fdd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ee00a2-1a9e-4419-a759-28a0bbce02b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:21:54 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Volume 602a2bac-3680-4932-90bf-94baad272bf4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-602a2bac-3680-4932-90bf-94baad272bf4', 'volume_size': 1, 'snapshot_id': 'b64d6309-710f-4116-bc35-b4ada5b26b02'} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-quobyte-b64d6309-710f-4116-bc35-b4ada5b26b02-602a2bac-3680-4932-90bf-94baad272bf4" by "_create_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-b64d6309-710f-4116-bc35-b4ada5b26b02-602a2bac-3680-4932-90bf-94baad272bf4" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Creating volume 602a2bac-3680-4932-90bf-94baad272bf4 from snapshot b64d6309-710f-4116-bc35-b4ada5b26b02 {{(pid=94407) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:21:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-quobyte-602a2bac-3680-4932-90bf-94baad272bf4" by "_copy_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-602a2bac-3680-4932-90bf-94baad272bf4" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] snapshot: b64d6309-710f-4116-bc35-b4ada5b26b02, volume: 602a2bac-3680-4932-90bf-94baad272bf4, {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 16:21:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-a3741bc9-b166-4bd0-9722-09a02569d182 req-745f6adc-43ea-4d11-b825-b7c2a1788bff tempest-TestInstancesWithCinderVolumes-824214854 None] Terminate volume connection completed successfully. Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-a3741bc9-b166-4bd0-9722-09a02569d182 req-745f6adc-43ea-4d11-b825-b7c2a1788bff tempest-TestInstancesWithCinderVolumes-824214854 None] Deleting attachment 0b419952-7ba2-47e7-a022-356899f372ca. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16ba6d5-65c6-4cfd-85e9-d7f9d7b7e308]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:55 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 Aug 26 16:21:55 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "cinder-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "cinder-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "cinder-quobyte-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:21:55 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02" returned: 0 in 0.452s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "cinder-quobyte-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7190dbc-0131-40b0-8f12-41b3deb77387]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[93054e63-e456-499e-977f-69add6d5d2ae]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:21:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:55 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a Aug 26 16:21:55 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:55 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56 Aug 26 16:21:55 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:56 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a" returned: 0 in 0.464s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] will copy from snapshot at /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Creating direct copy from snapshot {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG cinder.utils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Path /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4 not found in is_blk_device check {{(pid=94407) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:56 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4 Aug 26 16:21:56 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:56 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56" returned: 0 in 0.557s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:56 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56 Aug 26 16:21:56 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:56 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56" returned: 0 in 0.292s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "cinder-quobyte-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56" released by "delete_volume" :: held 0.909s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:21:56 devstack cinder-volume[94407]: WARNING cinder.quota [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1871672581-1389933961 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1871672581-1389933961, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:21:56 devstack cinder-volume[94407]: WARNING cinder.quota [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1871672581-1389933961 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1871672581-1389933961, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Created reservations ['372805ff-5014-41f2-bf61-76c47f4475a1', 'e448101c-b8c1-434a-a87d-3b0fc2adb204', '6f7feb9b-44b7-4d7f-9c2d-b63c771864ff', '7b84a620-49b3-40cd-a122-92dd72664b46'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:21:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:21:56 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:21:56 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:21:57 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Aug 26 16:21:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.828s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:21:57 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:21:57 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Deleted volume successfully. Aug 26 16:21:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ac5c0a73-ea57-4791-9e71-ce71d8235bfa tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "cinder-4dd062a4-cdf4-4cb0-9ae1-e05e0295dc56-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:02 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4" returned: 0 in 6.491s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:02 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4 {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:22:02 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Converted 1024.00 MB image at 157.74 MB/s Aug 26 16:22:02 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4 is being set with open permissions: ugo+rw Aug 26 16:22:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:02 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4 Aug 26 16:22:02 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:03 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4" returned: 0 in 0.622s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-602a2bac-3680-4932-90bf-94baad272bf4" released by "_copy_volume_from_snapshot" :: held 8.193s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-b64d6309-710f-4116-bc35-b4ada5b26b02-602a2bac-3680-4932-90bf-94baad272bf4" released by "_create_volume_from_snapshot" :: held 8.296s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.317s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ee00a2-1a9e-4419-a759-28a0bbce02b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602a2bac-3680-4932-90bf-94baad272bf4', 'volume_size': 1, 'snapshot_id': 'b64d6309-710f-4116-bc35-b4ada5b26b02'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba61cd55-4d9a-446e-8ed4-65a7ad87cd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:03 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Volume volume-602a2bac-3680-4932-90bf-94baad272bf4 (602a2bac-3680-4932-90bf-94baad272bf4): created successfully Aug 26 16:22:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba61cd55-4d9a-446e-8ed4-65a7ad87cd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Flow 'volume_create_manager' (d26c1143-69f0-4055-a98a-88f3aa1585b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:22:03 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f9e3282f-94ee-40d8-a5bc-3cefa96e694c tempest-VolumesDeleteCascade-2061725170 None] Created volume successfully. Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Performing cascade delete. {{(pid=94407) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-b64d6309-710f-4116-bc35-b4ada5b26b02-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-b64d6309-710f-4116-bc35-b4ada5b26b02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-quobyte-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-quobyte-b64d6309-710f-4116-bc35-b4ada5b26b02" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-b64d6309-710f-4116-bc35-b4ada5b26b02" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Deleting offline snapshot b64d6309-710f-4116-bc35-b4ada5b26b02 of volume a56ee3c7-80e3-4a41-b566-ebb3e4a4989a {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] snapshot_file for this snap is: volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19c9a10-4290-40dd-9f9c-e1e2336d3510]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:04 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-1be9b6df-93bd-4a7d-8b14-9181098cd310 req-ff3ba8ca-8f72-420b-b2d6-06b9c0392d28 tempest-TestInstancesWithCinderVolumes-824214854 None] Terminate volume connection completed successfully. Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-1be9b6df-93bd-4a7d-8b14-9181098cd310 req-ff3ba8ca-8f72-420b-b2d6-06b9c0392d28 tempest-TestInstancesWithCinderVolumes-824214854 None] Deleting attachment 5131e6b6-ff35-4dd0-8b23-a87c4534b392. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:22:04 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 Aug 26 16:22:04 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:04 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02" returned: 0 in 0.427s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d4a174-9fa5-490e-ba12-dc96a47ebf0c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:22:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:05 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a Aug 26 16:22:05 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "cinder-1be84bd9-93d7-4f37-a357-5d5453331888-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "cinder-1be84bd9-93d7-4f37-a357-5d5453331888-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:05 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a" returned: 0 in 0.841s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "cinder-quobyte-1be84bd9-93d7-4f37-a357-5d5453331888" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "cinder-quobyte-1be84bd9-93d7-4f37-a357-5d5453331888" acquired by "delete_volume" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:05 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 Aug 26 16:22:05 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:05 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d1ac4d-6ed9-4381-949d-be9f9ff4dd28]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:22:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:05 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 Aug 26 16:22:05 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:06 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02" returned: 0 in 0.461s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:06 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02 Aug 26 16:22:06 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:06 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888" returned: 0 in 0.458s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:06 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888 Aug 26 16:22:06 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:06 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a.b64d6309-710f-4116-bc35-b4ada5b26b02" returned: 0 in 0.375s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-b64d6309-710f-4116-bc35-b4ada5b26b02" released by "_delete_snapshot" :: held 2.267s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:06 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a" released by "delete_snapshot" :: held 2.316s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1be84bd9-93d7-4f37-a357-5d5453331888" returned: 0 in 0.345s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "cinder-quobyte-1be84bd9-93d7-4f37-a357-5d5453331888" released by "delete_volume" :: held 0.880s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:06 devstack cinder-volume[94407]: WARNING cinder.quota [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2106266766-334441549 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2106266766-334441549, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:22:06 devstack cinder-volume[94407]: WARNING cinder.quota [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2106266766-334441549 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2106266766-334441549, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Created reservations ['9dbafb8e-e6d7-48ad-9701-c2d79e82f238', 'd5481bd9-4fcc-4fc6-9ddb-f2be08abbb65', '9f566c42-e0cf-4dae-8f94-d1807b88065c', '794ca96e-6523-4ac5-ac12-41b6df2dbb8a'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Created reservations ['0a632b89-d4cc-4968-b146-c553b4fe4e1a', '42ea7fb2-693c-42bb-9158-4851be94b18e', 'c5d839a1-5ac4-42bd-801d-67f3745a684f', '59c4437d-c79f-4a28-966c-28c465af0637'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:22:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Delete snapshot completed successfully. Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-b64d6309-710f-4116-bc35-b4ada5b26b02-delete_snapshot" released by "delete_snapshot" :: held 2.598s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Snapshots deleted, issuing volume delete {{(pid=94407) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-quobyte-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a" acquired by "delete_volume" :: waited 0.042s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:06 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:22:06 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[73602745-511a-4eef-bea3-801df07db991]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:22:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:07 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a Aug 26 16:22:07 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:07 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.306s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:22:07 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Deleted volume successfully. Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7c9a5250-9862-409c-8902-beb98d43c687 tempest-TestInstancesWithCinderVolumes-824214854 None] Lock "cinder-1be84bd9-93d7-4f37-a357-5d5453331888-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:07 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a" returned: 0 in 0.431s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:07 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a Aug 26 16:22:07 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:07 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a" returned: 0 in 0.298s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a" released by "delete_volume" :: held 0.789s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Created reservations ['cc1355a8-48d8-49b8-821a-ab141aa0ac6f', '4b5dd78d-6545-4aab-8be5-28030c36de1e', '1da6e13d-f0c8-4387-b06e-142eab19d0d6', '27fb9f63-a135-4c65-bab4-c5af002a050f'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:07 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:22:07 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:08 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.374s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:08 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:22:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Deleted volume successfully. Aug 26 16:22:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8f33af5e-c910-4273-89a0-2b63a42aaa8c tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-a56ee3c7-80e3-4a41-b566-ebb3e4a4989a-delete_volume" released by "delete_volume" :: held 4.114s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-602a2bac-3680-4932-90bf-94baad272bf4-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-602a2bac-3680-4932-90bf-94baad272bf4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "cinder-quobyte-602a2bac-3680-4932-90bf-94baad272bf4" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-602a2bac-3680-4932-90bf-94baad272bf4" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:09 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e636d3-c583-4c6c-a725-8334c9b470c9]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:22:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-af3aafd5-f656-41ea-a267-ab9c7e7bbe5c req-8da1b7ef-7fb9-4717-b1f2-b4127c08c578 tempest-TestShelveInstance-45300708 None] Terminate volume connection completed successfully. Aug 26 16:22:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-af3aafd5-f656-41ea-a267-ab9c7e7bbe5c req-8da1b7ef-7fb9-4717-b1f2-b4127c08c578 tempest-TestShelveInstance-45300708 None] Deleting attachment 889cb028-099a-4854-acc2-b31e32452016. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:22:09 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4 Aug 26 16:22:09 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:09 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4" returned: 0 in 0.486s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:09 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4 Aug 26 16:22:09 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:09 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-602a2bac-3680-4932-90bf-94baad272bf4" returned: 0 in 0.295s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-quobyte-602a2bac-3680-4932-90bf-94baad272bf4" released by "delete_volume" :: held 0.830s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:09 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Created reservations ['a6fac576-33be-489a-9465-5bcf00d6e63d', '650321de-4170-484b-b12b-456cbf49ed92', 'cc3388db-94f7-47bf-9946-26e4bceb122f', 'f0fcda4d-1b45-4249-9729-3481caa25ead'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:22:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:10 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:22:10 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:10 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.413s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:10 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:22:10 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Deleted volume successfully. Aug 26 16:22:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ba5ee84d-b9e9-4ddc-9e97-50e77833b7c5 tempest-VolumesDeleteCascade-2061725170 None] Lock "cinder-602a2bac-3680-4932-90bf-94baad272bf4-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Flow 'volume_create_manager' (2a0a1ec1-d46e-474d-9c0a-3256c671753a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b0125b-0a15-494f-9e3c-a88a6b910237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b0125b-0a15-494f-9e3c-a88a6b910237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-149835448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf34c22-ad08-402e-93f8-355cf761e301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785cdcd7da274d97974d714bfda44d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:22:16Z,use_quota=True,user_id='d0d1804d42094200afad0c5ce0a95e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8222f369-1d3c-4b6e-93bd-f8e32a0baafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8222f369-1d3c-4b6e-93bd-f8e32a0baafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94aea306-2ed3-466a-9274-09e95fb3b87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94aea306-2ed3-466a-9274-09e95fb3b87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf34c22-ad08-402e-93f8-355cf761e301', 'volume_name': 'volume-6cf34c22-ad08-402e-93f8-355cf761e301', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe8a380-d25e-42fd-9976-350da1b3eb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe8a380-d25e-42fd-9976-350da1b3eb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152508d7-e626-4e93-9209-0783188be0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:16 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Volume 6cf34c22-ad08-402e-93f8-355cf761e301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf34c22-ad08-402e-93f8-355cf761e301', 'volume_size': 1} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-149835448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf34c22-ad08-402e-93f8-355cf761e301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785cdcd7da274d97974d714bfda44d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:22:16Z,use_quota=True,user_id='d0d1804d42094200afad0c5ce0a95e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Creating volume 6cf34c22-ad08-402e-93f8-355cf761e301 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:22:16 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:22:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6cf34c22-ad08-402e-93f8-355cf761e301 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:16 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6cf34c22-ad08-402e-93f8-355cf761e301 1073741824 Aug 26 16:22:16 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:17 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6cf34c22-ad08-402e-93f8-355cf761e301 1073741824" returned: 0 in 0.737s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6cf34c22-ad08-402e-93f8-355cf761e301 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:17 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6cf34c22-ad08-402e-93f8-355cf761e301 Aug 26 16:22:17 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-86d308f7-4a2f-430d-8b53-432a08c06629 req-518c085d-839d-4eb5-ba0d-ec7a1e40373d tempest-TestShelveInstance-45300708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:17 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6cf34c22-ad08-402e-93f8-355cf761e301" returned: 0 in 0.280s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-86d308f7-4a2f-430d-8b53-432a08c06629 req-518c085d-839d-4eb5-ba0d-ec7a1e40373d tempest-TestShelveInstance-45300708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.145s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-86d308f7-4a2f-430d-8b53-432a08c06629 req-518c085d-839d-4eb5-ba0d-ec7a1e40373d tempest-TestShelveInstance-45300708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152508d7-e626-4e93-9209-0783188be0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf34c22-ad08-402e-93f8-355cf761e301', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6210ff2c-63f8-4cf0-a370-a509a75047bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-86d308f7-4a2f-430d-8b53-432a08c06629 req-518c085d-839d-4eb5-ba0d-ec7a1e40373d tempest-TestShelveInstance-45300708 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd77a6fdb-6940-4835-aa91-bb87e0ee52fa', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:22:17 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Volume volume-6cf34c22-ad08-402e-93f8-355cf761e301 (6cf34c22-ad08-402e-93f8-355cf761e301): created successfully Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6210ff2c-63f8-4cf0-a370-a509a75047bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Flow 'volume_create_manager' (2a0a1ec1-d46e-474d-9c0a-3256c671753a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:22:17 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a358c4e6-e356-40b0-86c4-1be9b9729c3f tempest-VolumesMetadataTest-1788591623 None] Created volume successfully. Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:17 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-86d308f7-4a2f-430d-8b53-432a08c06629 req-518c085d-839d-4eb5-ba0d-ec7a1e40373d tempest-TestShelveInstance-45300708 None] attachment_update completed successfully. Aug 26 16:22:17 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:22:17 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:18 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.433s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:22:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:22:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 28 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:22:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:22:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Acquiring lock "cinder-6cf34c22-ad08-402e-93f8-355cf761e301-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Lock "cinder-6cf34c22-ad08-402e-93f8-355cf761e301-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Acquiring lock "cinder-quobyte-6cf34c22-ad08-402e-93f8-355cf761e301" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Lock "cinder-quobyte-6cf34c22-ad08-402e-93f8-355cf761e301" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:19 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d2bee0-b8c0-4793-9b84-0e5c3f34e1af]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:22:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6cf34c22-ad08-402e-93f8-355cf761e301 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:19 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6cf34c22-ad08-402e-93f8-355cf761e301 Aug 26 16:22:19 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:20 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6cf34c22-ad08-402e-93f8-355cf761e301" returned: 0 in 0.462s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6cf34c22-ad08-402e-93f8-355cf761e301 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:20 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6cf34c22-ad08-402e-93f8-355cf761e301 Aug 26 16:22:20 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:20 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6cf34c22-ad08-402e-93f8-355cf761e301" returned: 0 in 0.311s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Lock "cinder-quobyte-6cf34c22-ad08-402e-93f8-355cf761e301" released by "delete_volume" :: held 0.851s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:20 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Created reservations ['53f2a796-74f9-4f71-8aa8-2129093ae862', '7a9c0661-4e1a-4145-b7da-92b19b326535', '8691ac86-439a-4974-b945-b2348c0471dd', '32a080dc-a9fe-429a-b837-d453a27d63fa'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:22:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:20 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:20 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:20 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:22:20 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:21 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.283s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:21 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:22:21 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Deleted volume successfully. Aug 26 16:22:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b93bc692-a0e6-4a47-be71-e14957f5794c tempest-VolumesMetadataTest-1788591623 None] Lock "cinder-6cf34c22-ad08-402e-93f8-355cf761e301-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:30 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=93,cinder:SELECT=121,cinder:INSERT=34,cinder:DELETE=9 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:22:31 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=72,cinder:UPDATE=98,cinder:INSERT=23,cinder:DELETE=5 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Flow 'volume_create_manager' (46b3fa17-8786-48d4-b1e5-5f0ad541cc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855eefb4-0a35-4c1e-a049-62fc940bf761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855eefb4-0a35-4c1e-a049-62fc940bf761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-403955922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0ada3a-affc-4e52-803f-46f1fce13c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a02d9974b546169f27ce3841218a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:22:35Z,use_quota=True,user_id='d145e91400c7475a98dd4352b57e439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b2e1ca-3264-436e-8d64-1fb9fbd2e290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b2e1ca-3264-436e-8d64-1fb9fbd2e290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f573e4-d3a8-4a1a-ae3e-d25ca4abb9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f573e4-d3a8-4a1a-ae3e-d25ca4abb9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce0ada3a-affc-4e52-803f-46f1fce13c60', 'volume_name': 'volume-ce0ada3a-affc-4e52-803f-46f1fce13c60', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d0fa47-e5f7-4c11-8cb0-42f594298bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d0fa47-e5f7-4c11-8cb0-42f594298bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7fed5c9-2a27-4388-8729-e4371eec94b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:35 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Volume ce0ada3a-affc-4e52-803f-46f1fce13c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce0ada3a-affc-4e52-803f-46f1fce13c60', 'volume_size': 1} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-403955922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0ada3a-affc-4e52-803f-46f1fce13c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a02d9974b546169f27ce3841218a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:22:35Z,use_quota=True,user_id='d145e91400c7475a98dd4352b57e439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Creating volume ce0ada3a-affc-4e52-803f-46f1fce13c60 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:22:35 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:22:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ce0ada3a-affc-4e52-803f-46f1fce13c60 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:35 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ce0ada3a-affc-4e52-803f-46f1fce13c60 1073741824 Aug 26 16:22:35 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:36 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ce0ada3a-affc-4e52-803f-46f1fce13c60 1073741824" returned: 0 in 0.848s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ce0ada3a-affc-4e52-803f-46f1fce13c60 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:36 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ce0ada3a-affc-4e52-803f-46f1fce13c60 Aug 26 16:22:36 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:36 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ce0ada3a-affc-4e52-803f-46f1fce13c60" returned: 0 in 0.562s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:22:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7fed5c9-2a27-4388-8729-e4371eec94b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce0ada3a-affc-4e52-803f-46f1fce13c60', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda51851-86ca-4e6b-87f3-cc05c469b78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:37 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Volume volume-ce0ada3a-affc-4e52-803f-46f1fce13c60 (ce0ada3a-affc-4e52-803f-46f1fce13c60): created successfully Aug 26 16:22:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda51851-86ca-4e6b-87f3-cc05c469b78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Flow 'volume_create_manager' (46b3fa17-8786-48d4-b1e5-5f0ad541cc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:22:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ea9f0b5f-df4c-41f3-aef0-81c3ab754b73 tempest-VolumesActionsTest-589310872 None] Created volume successfully. Aug 26 16:22:37 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-41d43e10-fa84-4cfb-972f-bf97af248efe tempest-VolumesActionsTest-589310872 None] Acquiring lock "cinder-ce0ada3a-affc-4e52-803f-46f1fce13c60" by "attach_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:37 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-41d43e10-fa84-4cfb-972f-bf97af248efe tempest-VolumesActionsTest-589310872 None] Lock "cinder-ce0ada3a-affc-4e52-803f-46f1fce13c60" acquired by "attach_volume" :: waited 0.045s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-41d43e10-fa84-4cfb-972f-bf97af248efe tempest-VolumesActionsTest-589310872 None] Attaching volume ce0ada3a-affc-4e52-803f-46f1fce13c60 to instance b2681a50-9dd3-4fdf-9017-af108c1a6da3 at mountpoint /dev/vdb on host None. Aug 26 16:22:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-41d43e10-fa84-4cfb-972f-bf97af248efe tempest-VolumesActionsTest-589310872 None] Attach volume completed successfully. Aug 26 16:22:37 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-41d43e10-fa84-4cfb-972f-bf97af248efe tempest-VolumesActionsTest-589310872 None] Lock "cinder-ce0ada3a-affc-4e52-803f-46f1fce13c60" released by "attach_volume" :: held 0.217s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:39 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f01f7956-aca7-45c9-8129-1d47a7ab10c4 tempest-VolumesActionsTest-84909917 None] Terminate volume connection completed successfully. Aug 26 16:22:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f01f7956-aca7-45c9-8129-1d47a7ab10c4 tempest-VolumesActionsTest-84909917 None] Acquiring lock "cinder-ce0ada3a-affc-4e52-803f-46f1fce13c60-detach_volume" by "detach_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f01f7956-aca7-45c9-8129-1d47a7ab10c4 tempest-VolumesActionsTest-84909917 None] Lock "cinder-ce0ada3a-affc-4e52-803f-46f1fce13c60-detach_volume" acquired by "detach_volume" :: waited 0.054s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:39 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f01f7956-aca7-45c9-8129-1d47a7ab10c4 tempest-VolumesActionsTest-84909917 None] Detaching volume ce0ada3a-affc-4e52-803f-46f1fce13c60 from instance b2681a50-9dd3-4fdf-9017-af108c1a6da3. Aug 26 16:22:39 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f01f7956-aca7-45c9-8129-1d47a7ab10c4 tempest-VolumesActionsTest-84909917 None] Detach volume completed successfully. Aug 26 16:22:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f01f7956-aca7-45c9-8129-1d47a7ab10c4 tempest-VolumesActionsTest-84909917 None] Lock "cinder-ce0ada3a-affc-4e52-803f-46f1fce13c60-detach_volume" released by "detach_volume" :: held 0.178s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f4718681-df35-4c50-8543-9cdecaedeab3 tempest-VolumesActionsTest-589310872 None] Acquiring lock "cinder-ce0ada3a-affc-4e52-803f-46f1fce13c60-detach_volume" by "detach_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f4718681-df35-4c50-8543-9cdecaedeab3 tempest-VolumesActionsTest-589310872 None] Lock "cinder-ce0ada3a-affc-4e52-803f-46f1fce13c60-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:39 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f4718681-df35-4c50-8543-9cdecaedeab3 tempest-VolumesActionsTest-589310872 None] Volume detach called, but volume not attached. Aug 26 16:22:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f4718681-df35-4c50-8543-9cdecaedeab3 tempest-VolumesActionsTest-589310872 None] Lock "cinder-ce0ada3a-affc-4e52-803f-46f1fce13c60-detach_volume" released by "detach_volume" :: held 0.060s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Acquiring lock "cinder-ce0ada3a-affc-4e52-803f-46f1fce13c60-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Lock "cinder-ce0ada3a-affc-4e52-803f-46f1fce13c60-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Acquiring lock "cinder-quobyte-ce0ada3a-affc-4e52-803f-46f1fce13c60" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Lock "cinder-quobyte-ce0ada3a-affc-4e52-803f-46f1fce13c60" acquired by "delete_volume" :: waited 0.043s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:40 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e6792-aa0b-4a9a-9ad1-871091274598]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:22:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ce0ada3a-affc-4e52-803f-46f1fce13c60 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:40 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ce0ada3a-affc-4e52-803f-46f1fce13c60 Aug 26 16:22:40 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:22:41 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Flow 'volume_create_manager' (9f40f46a-07c2-4afc-85e5-7b9f9ad11d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307ac262-779d-4c1e-86ae-65c73ab5b2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ce0ada3a-affc-4e52-803f-46f1fce13c60" returned: 0 in 1.053s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ce0ada3a-affc-4e52-803f-46f1fce13c60 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307ac262-779d-4c1e-86ae-65c73ab5b2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2133188387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b0b778-ac14-4145-a1f0-dd1abbbade20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66b6b706c3f4c65b9fdafa305336471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:22:42Z,use_quota=True,user_id='c91f0415ace24b2588b2bba40b1e1ced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97949242-cfb5-4fe1-84a2-17436d9b5c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97949242-cfb5-4fe1-84a2-17436d9b5c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4aa6576-25c7-4ce7-8a4c-168d2e6639e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4aa6576-25c7-4ce7-8a4c-168d2e6639e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b0b778-ac14-4145-a1f0-dd1abbbade20', 'volume_name': 'volume-01b0b778-ac14-4145-a1f0-dd1abbbade20', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:41 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ce0ada3a-affc-4e52-803f-46f1fce13c60 Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83aeb3e-19e9-4ab1-b40c-eb43839c4fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83aeb3e-19e9-4ab1-b40c-eb43839c4fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:41 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba63252-695b-4524-b171-4a8a6af75593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:41 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Volume 01b0b778-ac14-4145-a1f0-dd1abbbade20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b0b778-ac14-4145-a1f0-dd1abbbade20', 'volume_size': 1} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2133188387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b0b778-ac14-4145-a1f0-dd1abbbade20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66b6b706c3f4c65b9fdafa305336471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:22:42Z,use_quota=True,user_id='c91f0415ace24b2588b2bba40b1e1ced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Creating volume 01b0b778-ac14-4145-a1f0-dd1abbbade20 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:22:41 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:22:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:41 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 1073741824 Aug 26 16:22:41 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:42 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ce0ada3a-affc-4e52-803f-46f1fce13c60" returned: 0 in 0.654s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Lock "cinder-quobyte-ce0ada3a-affc-4e52-803f-46f1fce13c60" released by "delete_volume" :: held 1.781s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:42 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Created reservations ['1260b396-0dcf-4803-9056-22a343926234', 'c8f92599-61ec-4610-9de0-c815aa09d919', '5aab2f64-5973-4433-82c4-67a778787996', '29eb0c5c-9bd2-43bf-99b9-ee0102346217'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:22:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:42 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:22:42 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:42 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 1073741824" returned: 0 in 0.985s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:42 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 Aug 26 16:22:42 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:43 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20" returned: 0 in 0.350s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:43 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:22:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:43 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba63252-695b-4524-b171-4a8a6af75593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b0b778-ac14-4145-a1f0-dd1abbbade20', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:43 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de97333f-aac7-476b-b502-4e080b8218ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:43 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Volume volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 (01b0b778-ac14-4145-a1f0-dd1abbbade20): created successfully Aug 26 16:22:43 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de97333f-aac7-476b-b502-4e080b8218ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:43 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Flow 'volume_create_manager' (9f40f46a-07c2-4afc-85e5-7b9f9ad11d85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:22:43 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.644s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:43 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:22:43 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Deleted volume successfully. Aug 26 16:22:43 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5b09061e-55ca-4240-8665-bcaa6f85c3a4 tempest-VolumesActionsTest-1372876332 None] Created volume successfully. Aug 26 16:22:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4f1a7a90-4706-4e6b-ab0b-b095ea013307 tempest-VolumesActionsTest-589310872 None] Lock "cinder-ce0ada3a-affc-4e52-803f-46f1fce13c60-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Flow 'volume_create_manager' (ab10db53-6da5-4742-85cf-13e26fa2a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ac4a2b-cd18-46f5-87b5-b369a718408c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ac4a2b-cd18-46f5-87b5-b369a718408c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1850510573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df21ab3-4e0e-4e54-ba17-28735427f373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a02d9974b546169f27ce3841218a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:22:47Z,use_quota=True,user_id='d145e91400c7475a98dd4352b57e439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f9e67d-1a98-4d72-87d3-2d48331c8ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f9e67d-1a98-4d72-87d3-2d48331c8ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18acc5c1-0ec0-4ed2-a67e-5282a55c9278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18acc5c1-0ec0-4ed2-a67e-5282a55c9278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df21ab3-4e0e-4e54-ba17-28735427f373', 'volume_name': 'volume-5df21ab3-4e0e-4e54-ba17-28735427f373', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64efd81-84db-49c3-8493-b5165c525cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64efd81-84db-49c3-8493-b5165c525cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08bcd9d9-9a75-4a24-ad3f-14e66df286d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:47 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Volume 5df21ab3-4e0e-4e54-ba17-28735427f373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df21ab3-4e0e-4e54-ba17-28735427f373', 'volume_size': 1} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1850510573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df21ab3-4e0e-4e54-ba17-28735427f373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a02d9974b546169f27ce3841218a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:22:47Z,use_quota=True,user_id='d145e91400c7475a98dd4352b57e439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Creating volume 5df21ab3-4e0e-4e54-ba17-28735427f373 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:22:47 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:22:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5df21ab3-4e0e-4e54-ba17-28735427f373 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:47 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5df21ab3-4e0e-4e54-ba17-28735427f373 1073741824 Aug 26 16:22:47 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:48 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5df21ab3-4e0e-4e54-ba17-28735427f373 1073741824" returned: 0 in 0.642s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5df21ab3-4e0e-4e54-ba17-28735427f373 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:48 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5df21ab3-4e0e-4e54-ba17-28735427f373 Aug 26 16:22:48 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:48 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5df21ab3-4e0e-4e54-ba17-28735427f373" returned: 0 in 0.337s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:22:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08bcd9d9-9a75-4a24-ad3f-14e66df286d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df21ab3-4e0e-4e54-ba17-28735427f373', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b5d649-c963-4efa-8925-b45ca1c297a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:48 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Volume volume-5df21ab3-4e0e-4e54-ba17-28735427f373 (5df21ab3-4e0e-4e54-ba17-28735427f373): created successfully Aug 26 16:22:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b5d649-c963-4efa-8925-b45ca1c297a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Flow 'volume_create_manager' (ab10db53-6da5-4742-85cf-13e26fa2a422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:22:48 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6f0b46f8-df68-4ea3-bf58-8392c9001a05 tempest-VolumesActionsTest-589310872 None] Created volume successfully. Aug 26 16:22:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Acquiring lock "cinder-5df21ab3-4e0e-4e54-ba17-28735427f373-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Lock "cinder-5df21ab3-4e0e-4e54-ba17-28735427f373-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Acquiring lock "cinder-quobyte-5df21ab3-4e0e-4e54-ba17-28735427f373" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Lock "cinder-quobyte-5df21ab3-4e0e-4e54-ba17-28735427f373" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:49 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ae1928-0cea-4b46-8f72-32d7f3a81ebc]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:22:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5df21ab3-4e0e-4e54-ba17-28735427f373 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:50 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5df21ab3-4e0e-4e54-ba17-28735427f373 Aug 26 16:22:50 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:50 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5df21ab3-4e0e-4e54-ba17-28735427f373" returned: 0 in 0.411s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5df21ab3-4e0e-4e54-ba17-28735427f373 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:50 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5df21ab3-4e0e-4e54-ba17-28735427f373 Aug 26 16:22:50 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:50 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5df21ab3-4e0e-4e54-ba17-28735427f373" returned: 0 in 0.306s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Lock "cinder-quobyte-5df21ab3-4e0e-4e54-ba17-28735427f373" released by "delete_volume" :: held 0.781s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:50 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Created reservations ['1059de4c-358b-4203-8615-fc2ae4ff1425', 'd9ad839e-568c-428e-8851-e17b36e926a5', '4f079102-4465-42c4-951e-f5d3c4d7f345', '643d85c8-e6c5-4bd9-8d61-a5ebb644d746'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:22:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:50 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:22:50 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:51 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.300s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:51 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:22:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Deleted volume successfully. Aug 26 16:22:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c03a97d3-dcd0-47b1-b449-7347d484c117 tempest-VolumesActionsTest-84909917 None] Lock "cinder-5df21ab3-4e0e-4e54-ba17-28735427f373-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:51 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Flow 'volume_create_manager' (90a92ca1-7f7f-4f5c-b96e-3df148aff96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a26fe3a-bcc2-44de-be3e-570d9e033175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a26fe3a-bcc2-44de-be3e-570d9e033175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1293389508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf6a3b9-18ee-4963-8060-955cfd50d8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a02d9974b546169f27ce3841218a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:22:52Z,use_quota=True,user_id='d145e91400c7475a98dd4352b57e439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94690b7-cdf1-45b1-8788-4a819ac6c25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94690b7-cdf1-45b1-8788-4a819ac6c25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae717921-6dc8-48ca-ba93-0fdda722ee0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae717921-6dc8-48ca-ba93-0fdda722ee0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaf6a3b9-18ee-4963-8060-955cfd50d8c9', 'volume_name': 'volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3c504b-1176-4bbe-80f9-aed4f917c4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3c504b-1176-4bbe-80f9-aed4f917c4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0126e3d6-b4cb-4637-bd1d-44fb2185398e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:52 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Volume aaf6a3b9-18ee-4963-8060-955cfd50d8c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9', 'volume_size': 1} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1293389508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf6a3b9-18ee-4963-8060-955cfd50d8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a02d9974b546169f27ce3841218a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:22:52Z,use_quota=True,user_id='d145e91400c7475a98dd4352b57e439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Creating volume aaf6a3b9-18ee-4963-8060-955cfd50d8c9 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:22:52 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:52 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9 1073741824 Aug 26 16:22:52 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:52 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9 1073741824" returned: 0 in 0.745s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:52 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9 Aug 26 16:22:52 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:53 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9" returned: 0 in 0.323s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:53 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:22:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0126e3d6-b4cb-4637-bd1d-44fb2185398e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc09c1e-5963-4cbe-bf85-2709ddcf179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:53 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Volume volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9 (aaf6a3b9-18ee-4963-8060-955cfd50d8c9): created successfully Aug 26 16:22:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc09c1e-5963-4cbe-bf85-2709ddcf179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:53 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Flow 'volume_create_manager' (90a92ca1-7f7f-4f5c-b96e-3df148aff96b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:22:53 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-325120db-b07b-4bd2-a524-8f41e8c44031 tempest-VolumesActionsTest-589310872 None] Created volume successfully. Aug 26 16:22:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Acquiring lock "cinder-aaf6a3b9-18ee-4963-8060-955cfd50d8c9-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Lock "cinder-aaf6a3b9-18ee-4963-8060-955cfd50d8c9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Acquiring lock "cinder-quobyte-aaf6a3b9-18ee-4963-8060-955cfd50d8c9" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Lock "cinder-quobyte-aaf6a3b9-18ee-4963-8060-955cfd50d8c9" acquired by "delete_volume" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:54 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aeabc3-1272-4020-b9f1-21f1b30a9ddd]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:22:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:54 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9 Aug 26 16:22:54 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:54 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9" returned: 0 in 0.560s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:55 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9 Aug 26 16:22:55 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:55 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-aaf6a3b9-18ee-4963-8060-955cfd50d8c9" returned: 0 in 0.430s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Lock "cinder-quobyte-aaf6a3b9-18ee-4963-8060-955cfd50d8c9" released by "delete_volume" :: held 1.079s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-af71e014-f593-4f29-ad71-3fdeff9d364e tempest-VolumesActionsTest-1372876332 None] Acquiring lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20" by "attach_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-af71e014-f593-4f29-ad71-3fdeff9d364e tempest-VolumesActionsTest-1372876332 None] Lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20" acquired by "attach_volume" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:55 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Created reservations ['f359a30a-099c-42ac-b969-d293fed1ed79', 'e3edc29c-455b-490a-8515-ad0d0ccd4810', 'd028aa2a-02ab-4d45-8a01-797967fc94f7', '5d608079-ca5e-47f3-a36c-156a65d530a1'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:22:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-af71e014-f593-4f29-ad71-3fdeff9d364e tempest-VolumesActionsTest-1372876332 None] Attaching volume 01b0b778-ac14-4145-a1f0-dd1abbbade20 to instance f3ac5d55-4910-4a46-a6e5-ad482bac2edd at mountpoint /dev/vdb on host None. Aug 26 16:22:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-af71e014-f593-4f29-ad71-3fdeff9d364e tempest-VolumesActionsTest-1372876332 None] Attach volume completed successfully. Aug 26 16:22:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-af71e014-f593-4f29-ad71-3fdeff9d364e tempest-VolumesActionsTest-1372876332 None] Lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20" released by "attach_volume" :: held 0.163s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:55 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:22:55 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-523f4435-5965-478f-9123-653ec6607e5c tempest-VolumesActionsTest-1372876332 None] Acquiring lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20-detach_volume" by "detach_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-523f4435-5965-478f-9123-653ec6607e5c tempest-VolumesActionsTest-1372876332 None] Lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:56 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-523f4435-5965-478f-9123-653ec6607e5c tempest-VolumesActionsTest-1372876332 None] Detaching volume 01b0b778-ac14-4145-a1f0-dd1abbbade20 from instance f3ac5d55-4910-4a46-a6e5-ad482bac2edd. Aug 26 16:22:56 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-523f4435-5965-478f-9123-653ec6607e5c tempest-VolumesActionsTest-1372876332 None] Detach volume completed successfully. Aug 26 16:22:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-523f4435-5965-478f-9123-653ec6607e5c tempest-VolumesActionsTest-1372876332 None] Lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20-detach_volume" released by "detach_volume" :: held 0.141s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:56 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.534s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:56 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:22:56 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Deleted volume successfully. Aug 26 16:22:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e78c6e0b-85e7-4c25-a39e-38f23a0175c2 tempest-VolumesActionsTest-84909917 None] Lock "cinder-aaf6a3b9-18ee-4963-8060-955cfd50d8c9-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:22:57 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:22:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Flow 'volume_create_manager' (aa48d4f7-f620-44f5-9ec9-4a148ee85b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:22:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add7e709-f2c0-468b-8c14-3ddb32490155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add7e709-f2c0-468b-8c14-3ddb32490155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1881294090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659f0c19-1ad2-4353-9e63-6f79481ca4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a02d9974b546169f27ce3841218a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:22:58Z,use_quota=True,user_id='d145e91400c7475a98dd4352b57e439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06e3218-b832-42f2-b842-968d16eaa834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06e3218-b832-42f2-b842-968d16eaa834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae37f1c-4502-499c-b9ae-3b71ae0432a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae37f1c-4502-499c-b9ae-3b71ae0432a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '659f0c19-1ad2-4353-9e63-6f79481ca4fc', 'volume_name': 'volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0224ba26-5455-485e-bb9d-21b434836166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0224ba26-5455-485e-bb9d-21b434836166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9014145f-0859-4588-8e6b-f41d267afe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:58 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Volume 659f0c19-1ad2-4353-9e63-6f79481ca4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc', 'volume_size': 1} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1881294090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659f0c19-1ad2-4353-9e63-6f79481ca4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a02d9974b546169f27ce3841218a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:22:58Z,use_quota=True,user_id='d145e91400c7475a98dd4352b57e439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Creating volume 659f0c19-1ad2-4353-9e63-6f79481ca4fc {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:22:58 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:58 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc 1073741824 Aug 26 16:22:58 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:58 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc 1073741824" returned: 0 in 0.601s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:22:58 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc Aug 26 16:22:58 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:22:59 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Aug 26 16:22:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc" returned: 0 in 0.337s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:22:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:22:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:22:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9014145f-0859-4588-8e6b-f41d267afe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60349cc-b383-49ed-9fe3-5005429c0622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:22:59 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Volume volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc (659f0c19-1ad2-4353-9e63-6f79481ca4fc): created successfully Aug 26 16:22:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60349cc-b383-49ed-9fe3-5005429c0622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:22:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Flow 'volume_create_manager' (aa48d4f7-f620-44f5-9ec9-4a148ee85b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:22:59 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-83f7c12f-3d55-43fd-ab3c-0f0c6959b113 tempest-VolumesActionsTest-589310872 None] Created volume successfully. Aug 26 16:22:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Acquiring lock "cinder-659f0c19-1ad2-4353-9e63-6f79481ca4fc-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Lock "cinder-659f0c19-1ad2-4353-9e63-6f79481ca4fc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Acquiring lock "cinder-quobyte-659f0c19-1ad2-4353-9e63-6f79481ca4fc" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:22:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Lock "cinder-quobyte-659f0c19-1ad2-4353-9e63-6f79481ca4fc" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:22:59 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd02f7c-f18b-4cde-8380-d6135da05e3d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:22:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:00 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc Aug 26 16:23:00 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:00 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc" returned: 0 in 0.405s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:00 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc Aug 26 16:23:00 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:00 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-659f0c19-1ad2-4353-9e63-6f79481ca4fc" returned: 0 in 0.322s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Lock "cinder-quobyte-659f0c19-1ad2-4353-9e63-6f79481ca4fc" released by "delete_volume" :: held 0.781s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:23:00 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Created reservations ['151ed714-748b-40a7-a5ed-aec480b212df', '7f1452ca-7a42-4182-ab55-ade5d1703d11', '9cfc65e9-c535-4356-9047-36f83828edd7', '0459f838-2c9f-4ac9-93c9-d48d5ee015d9'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:23:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:23:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:23:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:23:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:00 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:23:00 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:01 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.413s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:23:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Deleted volume successfully. Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e9103ac0-da55-4c3d-87f1-61c5a61c64cb tempest-VolumesActionsTest-84909917 None] Lock "cinder-659f0c19-1ad2-4353-9e63-6f79481ca4fc-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Flow 'volume_create_manager' (3ba1b462-a4ec-46ef-9287-9495f222406f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6108a822-5ba4-4ad3-98a3-1f83e6142293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6108a822-5ba4-4ad3-98a3-1f83e6142293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1642367241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5f145f-0dfd-4e53-9c81-6ce5f00871b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a02d9974b546169f27ce3841218a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:23:02Z,use_quota=True,user_id='d145e91400c7475a98dd4352b57e439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa78f77-2170-4f94-ba93-57fc219d1705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa78f77-2170-4f94-ba93-57fc219d1705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d327093-5de8-452a-92bc-cc74a663c00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d327093-5de8-452a-92bc-cc74a663c00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca5f145f-0dfd-4e53-9c81-6ce5f00871b5', 'volume_name': 'volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f360eb-f5f9-4e37-bf7a-89533f388481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f360eb-f5f9-4e37-bf7a-89533f388481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64220572-1f2d-4e9e-8e2b-7e088851f37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:01 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Volume ca5f145f-0dfd-4e53-9c81-6ce5f00871b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5', 'volume_size': 1} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1642367241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca5f145f-0dfd-4e53-9c81-6ce5f00871b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a02d9974b546169f27ce3841218a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:23:02Z,use_quota=True,user_id='d145e91400c7475a98dd4352b57e439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Creating volume ca5f145f-0dfd-4e53-9c81-6ce5f00871b5 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:23:01 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:23:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:02 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5 1073741824 Aug 26 16:23:02 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:02 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5 1073741824" returned: 0 in 0.581s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:02 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5 Aug 26 16:23:02 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:03 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5" returned: 0 in 0.442s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:23:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:23:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64220572-1f2d-4e9e-8e2b-7e088851f37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfdffbc-62a0-4d18-9171-11ec4820c412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:03 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Volume volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5 (ca5f145f-0dfd-4e53-9c81-6ce5f00871b5): created successfully Aug 26 16:23:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfdffbc-62a0-4d18-9171-11ec4820c412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Flow 'volume_create_manager' (3ba1b462-a4ec-46ef-9287-9495f222406f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:23:03 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8400c480-b0f7-46f7-ac66-db4a592f55a4 tempest-VolumesActionsTest-589310872 None] Created volume successfully. Aug 26 16:23:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Acquiring lock "cinder-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:23:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Lock "cinder-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:23:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Acquiring lock "cinder-quobyte-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:23:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Lock "cinder-quobyte-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:23:04 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a3d7f3-eb0f-4c35-b7a9-2501fbe3487a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:23:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:04 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5 Aug 26 16:23:04 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:04 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5" returned: 0 in 0.407s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:04 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5 Aug 26 16:23:04 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:05 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5" returned: 0 in 0.350s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Lock "cinder-quobyte-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5" released by "delete_volume" :: held 0.805s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:23:05 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Created reservations ['4363b157-e3a3-482e-ac63-dd984c0721d7', 'fa8021a2-ee07-4b95-9de3-2ebe188a82dd', '43aac214-fc79-4160-acde-7d8a59908b7a', 'ec9e000b-f86b-4830-b5ba-bcf003e22ffe'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:23:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:23:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:23:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:23:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:05 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:23:05 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:05 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.312s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:05 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:23:05 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Deleted volume successfully. Aug 26 16:23:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bdfdd6-8710-4ce6-a505-babe410589b1 tempest-VolumesActionsTest-84909917 None] Lock "cinder-ca5f145f-0dfd-4e53-9c81-6ce5f00871b5-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Flow 'volume_create_manager' (b084d746-4850-4ff6-a067-82ca0af686ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5140b72-d6ec-4a9e-abb1-b6fcafd2589f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5140b72-d6ec-4a9e-abb1-b6fcafd2589f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1233513336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15508051-386c-49a0-9077-3f8bc1f4b367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a02d9974b546169f27ce3841218a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:23:06Z,use_quota=True,user_id='d145e91400c7475a98dd4352b57e439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46d0187-b406-44fc-a0cf-ca66137ec33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46d0187-b406-44fc-a0cf-ca66137ec33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7da4041-3b76-49d1-9cfe-d1324379e142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7da4041-3b76-49d1-9cfe-d1324379e142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15508051-386c-49a0-9077-3f8bc1f4b367', 'volume_name': 'volume-15508051-386c-49a0-9077-3f8bc1f4b367', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957fe32d-9a4f-4c38-962a-f3137f698618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957fe32d-9a4f-4c38-962a-f3137f698618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d13e74-d960-4ee6-af53-a769269a9f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:06 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Volume 15508051-386c-49a0-9077-3f8bc1f4b367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15508051-386c-49a0-9077-3f8bc1f4b367', 'volume_size': 1} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1233513336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15508051-386c-49a0-9077-3f8bc1f4b367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0a02d9974b546169f27ce3841218a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:23:06Z,use_quota=True,user_id='d145e91400c7475a98dd4352b57e439d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Creating volume 15508051-386c-49a0-9077-3f8bc1f4b367 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:23:06 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-15508051-386c-49a0-9077-3f8bc1f4b367 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:06 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-15508051-386c-49a0-9077-3f8bc1f4b367 1073741824 Aug 26 16:23:06 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:06 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-15508051-386c-49a0-9077-3f8bc1f4b367 1073741824" returned: 0 in 0.574s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-15508051-386c-49a0-9077-3f8bc1f4b367 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:07 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-15508051-386c-49a0-9077-3f8bc1f4b367 Aug 26 16:23:07 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:07 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-15508051-386c-49a0-9077-3f8bc1f4b367" returned: 0 in 0.345s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:23:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:23:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d13e74-d960-4ee6-af53-a769269a9f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15508051-386c-49a0-9077-3f8bc1f4b367', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746a5d9e-cc06-4653-8087-15079fb7286b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:07 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Volume volume-15508051-386c-49a0-9077-3f8bc1f4b367 (15508051-386c-49a0-9077-3f8bc1f4b367): created successfully Aug 26 16:23:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746a5d9e-cc06-4653-8087-15079fb7286b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Flow 'volume_create_manager' (b084d746-4850-4ff6-a067-82ca0af686ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:23:07 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f10ea7e1-d3a1-48f8-acc1-c41970f1f055 tempest-VolumesActionsTest-589310872 None] Created volume successfully. Aug 26 16:23:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Acquiring lock "cinder-15508051-386c-49a0-9077-3f8bc1f4b367-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:23:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Lock "cinder-15508051-386c-49a0-9077-3f8bc1f4b367-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:23:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Acquiring lock "cinder-quobyte-15508051-386c-49a0-9077-3f8bc1f4b367" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:23:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Lock "cinder-quobyte-15508051-386c-49a0-9077-3f8bc1f4b367" acquired by "delete_volume" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:23:09 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad275e5f-a980-4249-8a18-af3d5bc81ca0]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:23:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-15508051-386c-49a0-9077-3f8bc1f4b367 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:09 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-15508051-386c-49a0-9077-3f8bc1f4b367 Aug 26 16:23:09 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:09 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-15508051-386c-49a0-9077-3f8bc1f4b367" returned: 0 in 0.447s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-15508051-386c-49a0-9077-3f8bc1f4b367 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:09 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-15508051-386c-49a0-9077-3f8bc1f4b367 Aug 26 16:23:09 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:10 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-15508051-386c-49a0-9077-3f8bc1f4b367" returned: 0 in 0.346s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Lock "cinder-quobyte-15508051-386c-49a0-9077-3f8bc1f4b367" released by "delete_volume" :: held 0.850s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:23:10 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-15865f8e-0825-4db9-bb97-8aa1762a820d tempest-TestShelveInstance-45300708 None] Terminate volume connection completed successfully. Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-15865f8e-0825-4db9-bb97-8aa1762a820d tempest-TestShelveInstance-45300708 None] Deleting attachment d77a6fdb-6940-4835-aa91-bb87e0ee52fa. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Created reservations ['fdc3ef00-264b-4cdc-bfb4-96c81d35befa', '7813bc7f-bbc8-4157-9b7a-bcb2b9966b57', 'e4d9bfb1-00f5-42f1-9632-7f4036d37397', '03351af2-b56e-4156-a615-ad79afeec4fc'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Acquiring lock "cinder-1f3d7edf-1e07-4eec-92a6-647fca84f38e-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:23:10 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:23:10 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Lock "cinder-1f3d7edf-1e07-4eec-92a6-647fca84f38e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Acquiring lock "cinder-quobyte-1f3d7edf-1e07-4eec-92a6-647fca84f38e" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Lock "cinder-quobyte-1f3d7edf-1e07-4eec-92a6-647fca84f38e" acquired by "delete_volume" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d381014-083f-46ca-be33-01a9082d1c22]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:10 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e Aug 26 16:23:10 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:10 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.385s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:23:10 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Deleted volume successfully. Aug 26 16:23:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8d293112-e525-449c-8a1d-e03cee114f46 tempest-VolumesActionsTest-589310872 None] Lock "cinder-15508051-386c-49a0-9077-3f8bc1f4b367-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:23:11 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e" returned: 0 in 0.575s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:11 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e Aug 26 16:23:11 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:11 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1f3d7edf-1e07-4eec-92a6-647fca84f38e" returned: 0 in 0.464s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Lock "cinder-quobyte-1f3d7edf-1e07-4eec-92a6-647fca84f38e" released by "delete_volume" :: held 1.118s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:23:11 devstack cinder-volume[94407]: DEBUG cinder.quota [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Created reservations ['4da2a598-17d6-41ca-9765-e710c127391f', '6c570427-5ccf-4d18-a475-da683222e5f5', 'fb8f06aa-d645-4060-89d3-628ffd97309c', '41f92232-0dd7-44ef-a07e-0ba194f1adf5'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:23:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:23:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:23:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:23:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:12 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:23:12 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:12 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.421s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:12 devstack cinder-volume[94407]: DEBUG cinder.manager [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:23:12 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Deleted volume successfully. Aug 26 16:23:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [req-3c0ff406-c3bd-487f-920d-e546dca714bb req-fd317e60-27d3-45a4-8c4b-e843cdf86ed9 tempest-TestShelveInstance-45300708 None] Lock "cinder-1f3d7edf-1e07-4eec-92a6-647fca84f38e-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:23:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-95fb6997-bd06-4f96-9999-7be5f8023056 tempest-VolumesActionsTest-1372876332 None] Acquiring lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20" by "attach_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:23:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-95fb6997-bd06-4f96-9999-7be5f8023056 tempest-VolumesActionsTest-1372876332 None] Lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20" acquired by "attach_volume" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:23:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-95fb6997-bd06-4f96-9999-7be5f8023056 tempest-VolumesActionsTest-1372876332 None] Attaching volume 01b0b778-ac14-4145-a1f0-dd1abbbade20 to instance ac32dbc7-32e3-42a2-800f-9787bdad8076 at mountpoint /dev/vdb on host None. Aug 26 16:23:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-95fb6997-bd06-4f96-9999-7be5f8023056 tempest-VolumesActionsTest-1372876332 None] Attach volume completed successfully. Aug 26 16:23:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-95fb6997-bd06-4f96-9999-7be5f8023056 tempest-VolumesActionsTest-1372876332 None] Lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20" released by "attach_volume" :: held 0.236s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:23:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7f5b46f0-8010-47c4-95ee-4376c032f4c2 tempest-VolumesActionsTest-1372876332 None] Acquiring lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20-detach_volume" by "detach_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:23:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7f5b46f0-8010-47c4-95ee-4376c032f4c2 tempest-VolumesActionsTest-1372876332 None] Lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:23:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7f5b46f0-8010-47c4-95ee-4376c032f4c2 tempest-VolumesActionsTest-1372876332 None] Detaching volume 01b0b778-ac14-4145-a1f0-dd1abbbade20 from instance ac32dbc7-32e3-42a2-800f-9787bdad8076. Aug 26 16:23:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7f5b46f0-8010-47c4-95ee-4376c032f4c2 tempest-VolumesActionsTest-1372876332 None] Detach volume completed successfully. Aug 26 16:23:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7f5b46f0-8010-47c4-95ee-4376c032f4c2 tempest-VolumesActionsTest-1372876332 None] Lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20-detach_volume" released by "detach_volume" :: held 0.127s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:23:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:23:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:23:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:23:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:23:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:18 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:23:18 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:18 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.404s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:23:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:23:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 28 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:23:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:23:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:23 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bf3730-55f4-41bb-a589-dbf74085fcd4]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:23:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:23 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 Aug 26 16:23:23 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:23 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20" returned: 0 in 0.485s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:23 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0e7a82-792f-41d5-a764-76baf6469679]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:23:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:24 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 Aug 26 16:23:24 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:24 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20" returned: 0 in 0.420s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.c841860b-7f94-4d34-b6c9-74b6e16485c6fz2fp04b.img {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:24 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.c841860b-7f94-4d34-b6c9-74b6e16485c6fz2fp04b.img Aug 26 16:23:24 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:26 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=67,cinder:UPDATE=89,cinder:INSERT=23,cinder:DELETE=8 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:23:31 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.c841860b-7f94-4d34-b6c9-74b6e16485c6fz2fp04b.img" returned: 0 in 7.084s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:31 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e07aab3-cb43-42e8-a678-a93205447a6e]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:23:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:31 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 Aug 26 16:23:31 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:32 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20" returned: 0 in 0.944s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:32 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20, size 1024.00 MB, duration 7.08 sec, destination /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.c841860b-7f94-4d34-b6c9-74b6e16485c6fz2fp04b.img {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:23:32 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] Converted 1024.00 MB image at 144.53 MB/s Aug 26 16:23:32 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=77,cinder:UPDATE=85,cinder:INSERT=18,cinder:DELETE=6 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:23:32 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] c841860b-7f94-4d34-b6c9-74b6e16485c6 was raw, no need to convert to raw {{(pid=94407) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 16:23:35 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:23:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Flow 'volume_create_manager' (a0412e18-a051-4c48-943e-ff0c5b4d367c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:23:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45e225b-d220-4702-859b-698e4ecb79a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45e225b-d220-4702-859b-698e4ecb79a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2028812830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f5cafa-829c-4a90-8487-b0f95cd5e11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05902ce17fe8439587e246dd978c3547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:23:35Z,use_quota=True,user_id='63afbceeafde4b109f001d5e638ff565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3717837-84df-4f45-8d69-f7983ae12371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3717837-84df-4f45-8d69-f7983ae12371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2487ee7b-46c8-4338-80e3-9d353e8aa483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2487ee7b-46c8-4338-80e3-9d353e8aa483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f5cafa-829c-4a90-8487-b0f95cd5e11f', 'volume_name': 'volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a08ade-9df2-43af-997e-2a46c9eebbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a08ade-9df2-43af-997e-2a46c9eebbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2fa06b-b983-4635-b994-21a199de425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:35 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Volume d3f5cafa-829c-4a90-8487-b0f95cd5e11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f', 'volume_size': 1} Aug 26 16:23:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:45 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:23:45 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=2 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:23:57 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:23:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Flow 'volume_create_manager' (f8a11a5f-0897-4ec9-bae3-da98035b3816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:23:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb78af19-7be9-4f32-b5c8-ddc4f61d703c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb78af19-7be9-4f32-b5c8-ddc4f61d703c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-726261509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a844d451-9f9c-4d78-a28c-da709df604f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5633c537cc94e8fa1c5f5bf902ed07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:23:57Z,use_quota=True,user_id='4b0b4717b54e46e89a6dd546f34b3d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5678c2e-94b9-44a5-95bd-4482c683e6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5678c2e-94b9-44a5-95bd-4482c683e6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca867f2-5af5-4659-80c5-98b22224c50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca867f2-5af5-4659-80c5-98b22224c50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a844d451-9f9c-4d78-a28c-da709df604f8', 'volume_name': 'volume-a844d451-9f9c-4d78-a28c-da709df604f8', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ff24bd-f71e-4d53-9e20-873458aa1319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ff24bd-f71e-4d53-9e20-873458aa1319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6478e1-bff6-4997-ba73-8393ce4b858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:57 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Volume a844d451-9f9c-4d78-a28c-da709df604f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a844d451-9f9c-4d78-a28c-da709df604f8', 'volume_size': 1} Aug 26 16:23:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.928s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] Uploaded volume to glance image-id: c841860b-7f94-4d34-b6c9-74b6e16485c6. {{(pid=94407) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.676s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2028812830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f5cafa-829c-4a90-8487-b0f95cd5e11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05902ce17fe8439587e246dd978c3547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:23:35Z,use_quota=True,user_id='63afbceeafde4b109f001d5e638ff565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Creating volume d3f5cafa-829c-4a90-8487-b0f95cd5e11f {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:23:58 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:58 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f 1073741824 Aug 26 16:23:58 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:58 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-504f08b2-1a93-4dfb-a53c-c7abb5c124cd tempest-VolumesActionsTest-1372876332 None] Copy volume to image completed successfully. Aug 26 16:23:58 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f 1073741824" returned: 0 in 0.430s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:58 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f Aug 26 16:23:58 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:59 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f" returned: 0 in 0.259s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-726261509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a844d451-9f9c-4d78-a28c-da709df604f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5633c537cc94e8fa1c5f5bf902ed07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:23:57Z,use_quota=True,user_id='4b0b4717b54e46e89a6dd546f34b3d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Creating volume a844d451-9f9c-4d78-a28c-da709df604f8 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:23:59 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a844d451-9f9c-4d78-a28c-da709df604f8 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2fa06b-b983-4635-b994-21a199de425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:59 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a844d451-9f9c-4d78-a28c-da709df604f8 1073741824 Aug 26 16:23:59 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabb5cd1-c27e-480c-9d6e-d4fbc110fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:23:59 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Volume volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f (d3f5cafa-829c-4a90-8487-b0f95cd5e11f): created successfully Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabb5cd1-c27e-480c-9d6e-d4fbc110fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Flow 'volume_create_manager' (a0412e18-a051-4c48-943e-ff0c5b4d367c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:23:59 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a5d69a03-697e-4b8d-baad-a15d92897c5f tempest-SnapshotMetadataTestJSON-323592286 None] Created volume successfully. Aug 26 16:23:59 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a844d451-9f9c-4d78-a28c-da709df604f8 1073741824" returned: 0 in 0.570s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:23:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a844d451-9f9c-4d78-a28c-da709df604f8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:23:59 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a844d451-9f9c-4d78-a28c-da709df604f8 Aug 26 16:23:59 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:00 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a844d451-9f9c-4d78-a28c-da709df604f8" returned: 0 in 0.319s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.079s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6478e1-bff6-4997-ba73-8393ce4b858d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a844d451-9f9c-4d78-a28c-da709df604f8', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6a759e-70c0-4ac9-a086-e9193c51b90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] Creating offline snapshot 1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 of volume d3f5cafa-829c-4a90-8487-b0f95cd5e11f {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:24:00 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Volume volume-a844d451-9f9c-4d78-a28c-da709df604f8 (a844d451-9f9c-4d78-a28c-da709df604f8): created successfully Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6a759e-70c0-4ac9-a086-e9193c51b90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Flow 'volume_create_manager' (f8a11a5f-0897-4ec9-bae3-da98035b3816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[9effa287-9556-4002-8c6e-64544ee9ba03]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:00 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e532db3d-27cf-410d-9f04-a11a307e1df3 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Created volume successfully. Aug 26 16:24:00 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f Aug 26 16:24:00 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:00 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f" returned: 0 in 0.435s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:00 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 1G Aug 26 16:24:00 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:01 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 1G" returned: 0 in 0.550s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:01 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 Aug 26 16:24:01 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:01 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2" returned: 0 in 0.415s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:01 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 is being set with open permissions: ugo+rw Aug 26 16:24:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:01 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 Aug 26 16:24:01 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:01 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2" returned: 0 in 0.363s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:02 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.info Aug 26 16:24:02 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-bc2c69f5-3fb0-43f4-9277-912ab97f0293 req-eca475c4-42d2-49f0-8ea0-24f3a95647ef tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:02 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.info" returned: 0 in 0.292s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:02 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.info is being set with open permissions: ugo+rw Aug 26 16:24:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:02 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.info Aug 26 16:24:02 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:02 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.info" returned: 0 in 0.261s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.970s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:02 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef459703-1be0-427d-b9be-6cb84e91d207]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:02 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b6393f3f-07a7-4b86-a803-5fca590f4d63 tempest-SnapshotMetadataTestJSON-323592286 None] Create snapshot completed successfully Aug 26 16:24:02 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 Aug 26 16:24:02 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:02 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20" returned: 0 in 0.398s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:02 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc18c6f-0db5-4032-a76f-4442f7d34f8f]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:03 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 Aug 26 16:24:03 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:03 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20" returned: 0 in 0.470s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:03 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img Aug 26 16:24:03 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Acquiring lock "cinder-1db60ba1-761c-4ed3-95dc-ea930ad5f2a2-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Lock "cinder-1db60ba1-761c-4ed3-95dc-ea930ad5f2a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Acquiring lock "cinder-quobyte-d3f5cafa-829c-4a90-8487-b0f95cd5e11f" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Lock "cinder-quobyte-d3f5cafa-829c-4a90-8487-b0f95cd5e11f" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Acquiring lock "cinder-quobyte-1db60ba1-761c-4ed3-95dc-ea930ad5f2a2" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Lock "cinder-quobyte-1db60ba1-761c-4ed3-95dc-ea930ad5f2a2" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Deleting offline snapshot 1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 of volume d3f5cafa-829c-4a90-8487-b0f95cd5e11f {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:24:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] snapshot_file for this snap is: volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:24:04 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43e4287-af9f-4280-af3c-2043aba8ce6a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:04 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 Aug 26 16:24:04 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:05 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2" returned: 0 in 0.986s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:24:05 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[3416d964-559b-4cf3-8ef5-df0db7441afc]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:05 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f Aug 26 16:24:05 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:06 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f" returned: 0 in 0.781s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:06 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 Aug 26 16:24:06 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Flow 'volume_create_manager' (fc6628af-0681-4c6a-89b3-be139dc5d8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123578af-58f9-4056-acca-e96d79d2945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123578af-58f9-4056-acca-e96d79d2945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1039017663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e7272f-24f5-4854-9a8a-600908c80f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba16ea30a3b4a67979bd2d88e83572f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:06Z,use_quota=True,user_id='fbc57b4c111a4cd38d2b3cd73d6ae24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46de164b-848a-4328-a85d-0ae7cb60fd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46de164b-848a-4328-a85d-0ae7cb60fd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6481198-13fe-41a8-b65e-fe9e048836e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6481198-13fe-41a8-b65e-fe9e048836e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e7272f-24f5-4854-9a8a-600908c80f1f', 'volume_name': 'volume-c0e7272f-24f5-4854-9a8a-600908c80f1f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51457127-836d-4c1d-8cef-7bfd7bcb934f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51457127-836d-4c1d-8cef-7bfd7bcb934f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a2eda8-1aa9-4cd7-9b75-10089fd3c664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:06 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Volume c0e7272f-24f5-4854-9a8a-600908c80f1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e7272f-24f5-4854-9a8a-600908c80f1f', 'volume_size': 1} Aug 26 16:24:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:07 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2" returned: 0 in 1.140s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:07 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2 Aug 26 16:24:07 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:08 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f.1db60ba1-761c-4ed3-95dc-ea930ad5f2a2" returned: 0 in 0.725s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Lock "cinder-quobyte-1db60ba1-761c-4ed3-95dc-ea930ad5f2a2" released by "_delete_snapshot" :: held 3.967s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Lock "cinder-quobyte-d3f5cafa-829c-4a90-8487-b0f95cd5e11f" released by "delete_snapshot" :: held 4.049s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:08 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Created reservations ['2ef6edcb-5714-46dc-b492-93cfbc8f8a6a', 'c3148b83-1bb3-4b4e-bb96-af8cf123e860', '7b4d6587-ffd6-40a3-8c31-c7b44892670e', '151797b7-ac0c-44b3-837b-f5ddf271911b'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:24:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Delete snapshot completed successfully. Aug 26 16:24:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a6c3896-29cb-4338-ab12-6c8c123874ba tempest-SnapshotMetadataTestJSON-323592286 None] Lock "cinder-1db60ba1-761c-4ed3-95dc-ea930ad5f2a2-delete_snapshot" released by "delete_snapshot" :: held 4.479s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:08 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img" returned: 0 in 5.419s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:08 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f301f8a1-7e74-4e59-bcd4-2f380b8228a6]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:09 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 Aug 26 16:24:09 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Acquiring lock "cinder-d3f5cafa-829c-4a90-8487-b0f95cd5e11f-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Lock "cinder-d3f5cafa-829c-4a90-8487-b0f95cd5e11f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Acquiring lock "cinder-quobyte-d3f5cafa-829c-4a90-8487-b0f95cd5e11f" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Lock "cinder-quobyte-d3f5cafa-829c-4a90-8487-b0f95cd5e11f" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:09 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1ca035-e6e0-4568-9b08-2aae4194f5f4]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:09 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f Aug 26 16:24:09 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:09 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20" returned: 0 in 0.679s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:09 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:24:09 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Converted 1024.00 MB image at 188.84 MB/s Aug 26 16:24:09 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] a495a9d7-9f91-43fb-a513-06be8dd2f4c5 was raw, converting to qcow2 {{(pid=94407) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 26 16:24:09 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f280c410-4db3-4356-99e0-47305b93d150]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:09 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img Aug 26 16:24:09 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:09 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f" returned: 0 in 0.453s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:09 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f Aug 26 16:24:09 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:10 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img" returned: 0 in 0.407s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:10 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d3f5cafa-829c-4a90-8487-b0f95cd5e11f" returned: 0 in 0.287s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Lock "cinder-quobyte-d3f5cafa-829c-4a90-8487-b0f95cd5e11f" released by "delete_volume" :: held 0.827s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:10 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img Aug 26 16:24:10 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Created reservations ['5bd8b68f-5e62-4c52-aa78-db9b3eb8a698', 'a4a687cd-7fb1-40ae-96fc-b3285c08126e', '9add4d8f-81c1-4550-bcf7-419637679bf1', '518f3da0-c263-4c6a-9c41-093350f0ea1c'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:10 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:24:10 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:10 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img" returned: 1 in 0.424s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img /opt/stack/data/cinder/conversion/vol_upload_ilffms3o {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:10 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img /opt/stack/data/cinder/conversion/vol_upload_ilffms3o Aug 26 16:24:10 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:10 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.455s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:24:10 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Deleted volume successfully. Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5fd3eafa-98b2-4535-b1fb-42a9f1f4586f tempest-SnapshotMetadataTestJSON-323592286 None] Lock "cinder-d3f5cafa-829c-4a90-8487-b0f95cd5e11f-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:10 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img /opt/stack/data/cinder/conversion/vol_upload_ilffms3o" returned: 0 in 0.483s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Image conversion details: src /opt/stack/data/cinder/conversion/01b0b778-ac14-4145-a1f0-dd1abbbade20.temp_image.a495a9d7-9f91-43fb-a513-06be8dd2f4c5vvjn6dwf.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ilffms3o {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:24:10 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d99d65d-644f-4d2b-a16d-03045c129901]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ilffms3o {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:11 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ilffms3o Aug 26 16:24:11 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:11 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ilffms3o" returned: 0 in 0.333s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.704s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Uploaded volume to glance image-id: a495a9d7-9f91-43fb-a513-06be8dd2f4c5. {{(pid=94407) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-bc2c69f5-3fb0-43f4-9277-912ab97f0293 req-eca475c4-42d2-49f0-8ea0-24f3a95647ef tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-bc2c69f5-3fb0-43f4-9277-912ab97f0293 req-eca475c4-42d2-49f0-8ea0-24f3a95647ef tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.065s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.713s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1039017663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e7272f-24f5-4854-9a8a-600908c80f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba16ea30a3b4a67979bd2d88e83572f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:06Z,use_quota=True,user_id='fbc57b4c111a4cd38d2b3cd73d6ae24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Creating volume c0e7272f-24f5-4854-9a8a-600908c80f1f {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:24:13 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c9076d25-c247-4c68-bcd7-9a989077d4cc tempest-VolumesActionsTest-1372876332 None] Copy volume to image completed successfully. Aug 26 16:24:13 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f 1073741824 Aug 26 16:24:13 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-bc2c69f5-3fb0-43f4-9277-912ab97f0293 req-eca475c4-42d2-49f0-8ea0-24f3a95647ef tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-a844d451-9f9c-4d78-a28c-da709df604f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec94de55-db9b-434b-986b-bce538a08548', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:24:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-bc2c69f5-3fb0-43f4-9277-912ab97f0293 req-eca475c4-42d2-49f0-8ea0-24f3a95647ef tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] attachment_update completed successfully. Aug 26 16:24:14 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f 1073741824" returned: 0 in 0.852s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:14 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f Aug 26 16:24:14 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:14 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f" returned: 0 in 0.256s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:24:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a2eda8-1aa9-4cd7-9b75-10089fd3c664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e7272f-24f5-4854-9a8a-600908c80f1f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851191d6-91b4-48f8-9e05-b02b6d049594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:14 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Volume volume-c0e7272f-24f5-4854-9a8a-600908c80f1f (c0e7272f-24f5-4854-9a8a-600908c80f1f): created successfully Aug 26 16:24:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851191d6-91b4-48f8-9e05-b02b6d049594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Flow 'volume_create_manager' (fc6628af-0681-4c6a-89b3-be139dc5d8a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:14 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-55c6eea9-911e-4769-8082-550b954ad9e8 tempest-TestStampPattern-600342741 None] Created volume successfully. Aug 26 16:24:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Acquiring lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Acquiring lock "cinder-quobyte-01b0b778-ac14-4145-a1f0-dd1abbbade20" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Lock "cinder-quobyte-01b0b778-ac14-4145-a1f0-dd1abbbade20" acquired by "delete_volume" :: waited 0.027s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:15 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9ee261-0902-4f5c-a78d-78abedc6db64]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:15 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 Aug 26 16:24:15 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:15 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20" returned: 0 in 0.379s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:15 devstack sudo[109336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20 Aug 26 16:24:15 devstack sudo[109336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:16 devstack sudo[109336]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01b0b778-ac14-4145-a1f0-dd1abbbade20" returned: 0 in 0.444s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Lock "cinder-quobyte-01b0b778-ac14-4145-a1f0-dd1abbbade20" released by "delete_volume" :: held 0.891s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:16 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Created reservations ['aa08406c-8719-4a8d-bdfb-74454cfba90d', '367d8782-ab95-412e-87ad-55391c022064', 'c80d3db9-f744-4dfa-8935-77f889dead85', 'aa461d15-7f93-406a-ae8e-52406b77310e'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:24:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:16 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:24:16 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:16 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.329s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:16 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:24:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Deleted volume successfully. Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d1981cec-84e4-4612-86be-34c331e00f05 tempest-VolumesActionsTest-1372876332 None] Lock "cinder-01b0b778-ac14-4145-a1f0-dd1abbbade20-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Flow 'volume_create_manager' (dd590459-47d7-425d-aa24-005d96dec830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e607301-737e-417f-98ce-be30a64631dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e607301-737e-417f-98ce-be30a64631dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-364031986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90997275-f2f4-4565-a62b-e9b4ab1dec38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de3f9f476f24064b0c735cbf3f18840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:17Z,use_quota=True,user_id='e681e333a0444aea81c26fbbfa5a8be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6831ccf6-c767-433a-a962-397ae316b5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6831ccf6-c767-433a-a962-397ae316b5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5081b996-2d54-4ddc-946c-9b035aacfa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5081b996-2d54-4ddc-946c-9b035aacfa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90997275-f2f4-4565-a62b-e9b4ab1dec38', 'volume_name': 'volume-90997275-f2f4-4565-a62b-e9b4ab1dec38', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f350f57-4d67-4cba-a64f-aef96bcd7d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f350f57-4d67-4cba-a64f-aef96bcd7d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37248e15-c769-44b3-ab1f-60ffb475d4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:17 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Volume 90997275-f2f4-4565-a62b-e9b4ab1dec38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90997275-f2f4-4565-a62b-e9b4ab1dec38', 'volume_size': 1} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-364031986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90997275-f2f4-4565-a62b-e9b4ab1dec38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de3f9f476f24064b0c735cbf3f18840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:17Z,use_quota=True,user_id='e681e333a0444aea81c26fbbfa5a8be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Creating volume 90997275-f2f4-4565-a62b-e9b4ab1dec38 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:24:17 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90997275-f2f4-4565-a62b-e9b4ab1dec38 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:17 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90997275-f2f4-4565-a62b-e9b4ab1dec38 1073741824 Aug 26 16:24:17 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:18 devstack sudo[109347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:24:18 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:18 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90997275-f2f4-4565-a62b-e9b4ab1dec38 1073741824" returned: 0 in 0.814s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90997275-f2f4-4565-a62b-e9b4ab1dec38 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:18 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90997275-f2f4-4565-a62b-e9b4ab1dec38 Aug 26 16:24:18 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:18 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.657s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:24:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:24:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 28 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:24:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:24:19 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90997275-f2f4-4565-a62b-e9b4ab1dec38" returned: 0 in 0.710s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:19 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:24:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:19 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37248e15-c769-44b3-ab1f-60ffb475d4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90997275-f2f4-4565-a62b-e9b4ab1dec38', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:19 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259c0f3b-6270-4d3f-9b03-ef8f06eb1828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:19 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Volume volume-90997275-f2f4-4565-a62b-e9b4ab1dec38 (90997275-f2f4-4565-a62b-e9b4ab1dec38): created successfully Aug 26 16:24:19 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259c0f3b-6270-4d3f-9b03-ef8f06eb1828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:19 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Flow 'volume_create_manager' (dd590459-47d7-425d-aa24-005d96dec830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:19 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-02d52c2c-36de-4730-8da9-be460b72857c req-4836b97c-dfa5-4cca-97a7-e2b455696f6d tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Terminate volume connection completed successfully. Aug 26 16:24:19 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-02d52c2c-36de-4730-8da9-be460b72857c req-4836b97c-dfa5-4cca-97a7-e2b455696f6d tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Deleting attachment ec94de55-db9b-434b-986b-bce538a08548. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:24:19 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ce6e8eb7-b488-4b96-9ce0-ebb22e0a96e8 tempest-VolumesTransfersTest-104064086 None] Created volume successfully. Aug 26 16:24:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Acquiring lock "cinder-a844d451-9f9c-4d78-a28c-da709df604f8-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Lock "cinder-a844d451-9f9c-4d78-a28c-da709df604f8-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Acquiring lock "cinder-quobyte-a844d451-9f9c-4d78-a28c-da709df604f8" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Lock "cinder-quobyte-a844d451-9f9c-4d78-a28c-da709df604f8" acquired by "delete_volume" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:20 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[831b353c-559e-450c-8208-6b0d5c6bd7fe]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a844d451-9f9c-4d78-a28c-da709df604f8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:20 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a844d451-9f9c-4d78-a28c-da709df604f8 Aug 26 16:24:20 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:20 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a844d451-9f9c-4d78-a28c-da709df604f8" returned: 0 in 0.709s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a844d451-9f9c-4d78-a28c-da709df604f8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:20 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e23687f0-9b4a-4f0d-9e78-20a2c042591b tempest-VolumesTransfersTest-1480634767 None] Transfer volume completed successfully. Aug 26 16:24:20 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a844d451-9f9c-4d78-a28c-da709df604f8 Aug 26 16:24:20 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a844d451-9f9c-4d78-a28c-da709df604f8" returned: 0 in 0.422s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:21 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Lock "cinder-quobyte-a844d451-9f9c-4d78-a28c-da709df604f8" released by "delete_volume" :: held 1.220s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:21 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Created reservations ['b47d597a-96c9-4deb-beac-f3c515b841d2', '28d952c7-a2a1-4d9a-8c0c-4bed703ef26f', '62ed11d2-952a-4498-87a8-f91af097d590', '784f8260-e271-4af3-83d8-9b8d0347f09c'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:24:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:21 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:24:21 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Acquiring lock "cinder-90997275-f2f4-4565-a62b-e9b4ab1dec38-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Lock "cinder-90997275-f2f4-4565-a62b-e9b4ab1dec38-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Acquiring lock "cinder-quobyte-90997275-f2f4-4565-a62b-e9b4ab1dec38" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Lock "cinder-quobyte-90997275-f2f4-4565-a62b-e9b4ab1dec38" acquired by "delete_volume" :: waited 0.032s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:22 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[35201e07-3b46-4481-85ef-4a5981e317d5]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90997275-f2f4-4565-a62b-e9b4ab1dec38 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:22 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.804s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:22 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:24:22 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Deleted volume successfully. Aug 26 16:24:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ebe583dc-b32b-43de-8d6b-6fb02d097898 tempest-TestServerVolumeAttachScenarioOldVersion-2089515612 None] Lock "cinder-a844d451-9f9c-4d78-a28c-da709df604f8-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:22 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90997275-f2f4-4565-a62b-e9b4ab1dec38 Aug 26 16:24:22 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:23 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90997275-f2f4-4565-a62b-e9b4ab1dec38" returned: 0 in 1.128s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90997275-f2f4-4565-a62b-e9b4ab1dec38 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:23 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90997275-f2f4-4565-a62b-e9b4ab1dec38 Aug 26 16:24:23 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:24 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-90997275-f2f4-4565-a62b-e9b4ab1dec38" returned: 0 in 0.569s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Lock "cinder-quobyte-90997275-f2f4-4565-a62b-e9b4ab1dec38" released by "delete_volume" :: held 1.786s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:24 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Created reservations ['9685e845-60c5-48af-a848-54e7f303d9f6', '87d96af8-6569-4048-92ab-f3a1b7a4a7e7', 'f616da81-1d62-4932-afe1-19b1c5f6b75f', '43325dd7-1b56-40f1-a8ba-efe323f927ab'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:24:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:24 devstack sudo[109466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:24:24 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:24 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.474s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:24 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:24:24 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Deleted volume successfully. Aug 26 16:24:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f62c25ad-c3de-4f91-a792-e3ec63c69466 tempest-VolumesTransfersTest-799640792 None] Lock "cinder-90997275-f2f4-4565-a62b-e9b4ab1dec38-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Flow 'volume_create_manager' (314c7036-6030-4711-8dd9-f44b0b54b5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a95f0e6-08d8-4ad9-85cf-835e051e5d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a95f0e6-08d8-4ad9-85cf-835e051e5d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1197971729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c1419b-190c-4e92-bd37-53abbd60d36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de3f9f476f24064b0c735cbf3f18840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:26Z,use_quota=True,user_id='e681e333a0444aea81c26fbbfa5a8be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63efb9f-70c8-4aed-8096-289876338aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63efb9f-70c8-4aed-8096-289876338aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a59c4a-939f-46b3-8d23-dd4abf63df17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a59c4a-939f-46b3-8d23-dd4abf63df17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c1419b-190c-4e92-bd37-53abbd60d36e', 'volume_name': 'volume-25c1419b-190c-4e92-bd37-53abbd60d36e', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d40459d-b526-4ecf-8a49-c0c6caf2366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d40459d-b526-4ecf-8a49-c0c6caf2366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3de7ae-47d5-4106-b256-fbe622c996f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:25 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Volume 25c1419b-190c-4e92-bd37-53abbd60d36e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c1419b-190c-4e92-bd37-53abbd60d36e', 'volume_size': 1} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1197971729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c1419b-190c-4e92-bd37-53abbd60d36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de3f9f476f24064b0c735cbf3f18840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:26Z,use_quota=True,user_id='e681e333a0444aea81c26fbbfa5a8be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Creating volume 25c1419b-190c-4e92-bd37-53abbd60d36e {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:24:25 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:24:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-25c1419b-190c-4e92-bd37-53abbd60d36e 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:25 devstack sudo[109472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-25c1419b-190c-4e92-bd37-53abbd60d36e 1073741824 Aug 26 16:24:25 devstack sudo[109472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:26 devstack sudo[109472]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-25c1419b-190c-4e92-bd37-53abbd60d36e 1073741824" returned: 0 in 0.540s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-25c1419b-190c-4e92-bd37-53abbd60d36e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:26 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-25c1419b-190c-4e92-bd37-53abbd60d36e Aug 26 16:24:26 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:26 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-25c1419b-190c-4e92-bd37-53abbd60d36e" returned: 0 in 0.343s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:26 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:24:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3de7ae-47d5-4106-b256-fbe622c996f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c1419b-190c-4e92-bd37-53abbd60d36e', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f4ed2c-5ab3-4181-bcea-6d01eb09cdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:26 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Volume volume-25c1419b-190c-4e92-bd37-53abbd60d36e (25c1419b-190c-4e92-bd37-53abbd60d36e): created successfully Aug 26 16:24:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f4ed2c-5ab3-4181-bcea-6d01eb09cdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Flow 'volume_create_manager' (314c7036-6030-4711-8dd9-f44b0b54b5e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:26 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ed95e0a1-23ec-49c9-9f64-2941e05170eb tempest-VolumesTransfersTest-104064086 None] Created volume successfully. Aug 26 16:24:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Acquiring lock "cinder-25c1419b-190c-4e92-bd37-53abbd60d36e-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Lock "cinder-25c1419b-190c-4e92-bd37-53abbd60d36e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Acquiring lock "cinder-quobyte-25c1419b-190c-4e92-bd37-53abbd60d36e" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Lock "cinder-quobyte-25c1419b-190c-4e92-bd37-53abbd60d36e" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:28 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e117c1a8-e37e-4bcf-b9e5-1ed4e9f343f0]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-25c1419b-190c-4e92-bd37-53abbd60d36e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:28 devstack sudo[109485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-25c1419b-190c-4e92-bd37-53abbd60d36e Aug 26 16:24:28 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:28 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-25c1419b-190c-4e92-bd37-53abbd60d36e" returned: 0 in 0.426s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-25c1419b-190c-4e92-bd37-53abbd60d36e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:28 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-25c1419b-190c-4e92-bd37-53abbd60d36e Aug 26 16:24:28 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:28 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-25c1419b-190c-4e92-bd37-53abbd60d36e" returned: 0 in 0.334s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Lock "cinder-quobyte-25c1419b-190c-4e92-bd37-53abbd60d36e" released by "delete_volume" :: held 0.818s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:29 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Created reservations ['80b915b2-4f45-4146-ba45-08e1d6992d46', 'd29f716f-61bc-4fac-95af-0712706e056c', '16f7ed4b-9909-47a7-8d8f-a9f5227106f2', '042b0c61-0146-4d69-b5e4-247c546c4ffe'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:24:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:29 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:24:29 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:29 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.276s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:29 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:24:29 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Deleted volume successfully. Aug 26 16:24:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-82b31ef5-a354-4598-8a8a-e2b2023b6d10 tempest-VolumesTransfersTest-799640792 None] Lock "cinder-25c1419b-190c-4e92-bd37-53abbd60d36e-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:39 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=58,cinder:INSERT=16,cinder:UPDATE=60,cinder:DELETE=5 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:24:39 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=68,cinder:SELECT=49,cinder:DELETE=6,cinder:INSERT=14 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Flow 'volume_create_manager' (0656f4af-5aeb-4d63-9b6f-dc1fbb01650f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd46e15-7e2c-4a38-b1c6-50006fa465c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd46e15-7e2c-4a38-b1c6-50006fa465c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-187321768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad4a6da-4d7c-433a-b46c-861dbed95b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d459a87761f34f8fb908c37642354d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:40Z,use_quota=True,user_id='3f867f7ee30543159bb71ff06d2deeb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baaf26f-ffa3-46ba-a77b-99bb9880e8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baaf26f-ffa3-46ba-a77b-99bb9880e8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aeeb968-af3f-47ed-8ec6-59e6b68771bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aeeb968-af3f-47ed-8ec6-59e6b68771bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ad4a6da-4d7c-433a-b46c-861dbed95b24', 'volume_name': 'volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058c971d-88d5-4ee7-8d1d-b244d4496f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058c971d-88d5-4ee7-8d1d-b244d4496f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e3c321-50dd-4294-9e84-fee20bb3c8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:40 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Volume 1ad4a6da-4d7c-433a-b46c-861dbed95b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24', 'volume_size': 1} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-187321768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad4a6da-4d7c-433a-b46c-861dbed95b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d459a87761f34f8fb908c37642354d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:40Z,use_quota=True,user_id='3f867f7ee30543159bb71ff06d2deeb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Creating volume 1ad4a6da-4d7c-433a-b46c-861dbed95b24 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:24:40 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:40 devstack sudo[109523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24 1073741824 Aug 26 16:24:40 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:40 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24 1073741824" returned: 0 in 0.519s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:40 devstack sudo[109529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24 Aug 26 16:24:40 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:41 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24" returned: 0 in 0.277s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:24:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e3c321-50dd-4294-9e84-fee20bb3c8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76758ed-f3e4-4490-bdd5-91650f7e73c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:41 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Volume volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24 (1ad4a6da-4d7c-433a-b46c-861dbed95b24): created successfully Aug 26 16:24:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76758ed-f3e4-4490-bdd5-91650f7e73c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Flow 'volume_create_manager' (0656f4af-5aeb-4d63-9b6f-dc1fbb01650f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:41 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-21a7a821-045a-4503-9623-50f5fbaf6c3c tempest-VolumesTransfersV355Test-1884984293 None] Created volume successfully. Aug 26 16:24:43 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-42df3ef8-ce07-49cb-be0e-e04f0b0e694f tempest-VolumesTransfersV355Test-1601794695 None] Transfer volume completed successfully. Aug 26 16:24:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Acquiring lock "cinder-1ad4a6da-4d7c-433a-b46c-861dbed95b24-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Lock "cinder-1ad4a6da-4d7c-433a-b46c-861dbed95b24-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Acquiring lock "cinder-quobyte-1ad4a6da-4d7c-433a-b46c-861dbed95b24" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-c2193c2b-0749-4798-a639-89c5d4b5a55d req-90f5e0bb-7360-4cb5-baf2-82d41697ef1f tempest-TestStampPattern-600342741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-c2193c2b-0749-4798-a639-89c5d4b5a55d req-90f5e0bb-7360-4cb5-baf2-82d41697ef1f tempest-TestStampPattern-600342741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-c2193c2b-0749-4798-a639-89c5d4b5a55d req-90f5e0bb-7360-4cb5-baf2-82d41697ef1f tempest-TestStampPattern-600342741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Lock "cinder-quobyte-1ad4a6da-4d7c-433a-b46c-861dbed95b24" acquired by "delete_volume" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:44 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bec7e04-d751-4cad-8484-7be3b5d46abc]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-c2193c2b-0749-4798-a639-89c5d4b5a55d req-90f5e0bb-7360-4cb5-baf2-82d41697ef1f tempest-TestStampPattern-600342741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-c0e7272f-24f5-4854-9a8a-600908c80f1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '367ac3fc-1007-4ba9-9c7a-d5367fb60d22', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:24:44 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-c2193c2b-0749-4798-a639-89c5d4b5a55d req-90f5e0bb-7360-4cb5-baf2-82d41697ef1f tempest-TestStampPattern-600342741 None] attachment_update completed successfully. Aug 26 16:24:44 devstack sudo[109549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24 Aug 26 16:24:44 devstack sudo[109549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:44 devstack sudo[109549]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24" returned: 0 in 0.538s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:44 devstack sudo[109625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24 Aug 26 16:24:44 devstack sudo[109625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:45 devstack sudo[109625]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1ad4a6da-4d7c-433a-b46c-861dbed95b24" returned: 0 in 0.325s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Lock "cinder-quobyte-1ad4a6da-4d7c-433a-b46c-861dbed95b24" released by "delete_volume" :: held 0.906s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:45 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Created reservations ['bc945259-c838-4851-bb70-3869bafa234b', '4de336c0-93f8-409e-a992-05f4ebcddfa4', 'adbfda21-2825-48f9-949e-bddef4e7b8b4', 'e8ed491d-f994-456f-89ec-a6704aa9dc79'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:24:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:45 devstack sudo[109945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:24:45 devstack sudo[109945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:45 devstack sudo[109945]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.323s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:45 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:24:45 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Deleted volume successfully. Aug 26 16:24:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f446cd07-5286-48ee-8a44-9bb1b6a75ee7 tempest-VolumesTransfersV355Test-817008250 None] Lock "cinder-1ad4a6da-4d7c-433a-b46c-861dbed95b24-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Flow 'volume_create_manager' (712ae569-5e97-41be-a3d1-1004c78c9584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0cc484-6ef3-4ecb-ab58-a4f43ac4a22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0cc484-6ef3-4ecb-ab58-a4f43ac4a22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-113661506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ab0c73-d762-47ce-a21a-f5bca37e84cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d459a87761f34f8fb908c37642354d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:47Z,use_quota=True,user_id='3f867f7ee30543159bb71ff06d2deeb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b31e1e-82f3-4bd2-b2e4-36778af62438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b31e1e-82f3-4bd2-b2e4-36778af62438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5702af-5693-4c68-baa4-9a6e0bab8222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5702af-5693-4c68-baa4-9a6e0bab8222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ab0c73-d762-47ce-a21a-f5bca37e84cc', 'volume_name': 'volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe13871-9b58-4e72-8cf5-0c426a59fc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe13871-9b58-4e72-8cf5-0c426a59fc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce50692-598e-4241-a9c0-0b03868c2773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:47 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Volume a2ab0c73-d762-47ce-a21a-f5bca37e84cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc', 'volume_size': 1} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-113661506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ab0c73-d762-47ce-a21a-f5bca37e84cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d459a87761f34f8fb908c37642354d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:47Z,use_quota=True,user_id='3f867f7ee30543159bb71ff06d2deeb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Creating volume a2ab0c73-d762-47ce-a21a-f5bca37e84cc {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:24:47 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:47 devstack sudo[109959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc 1073741824 Aug 26 16:24:47 devstack sudo[109959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:47 devstack sudo[109959]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc 1073741824" returned: 0 in 0.740s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:48 devstack sudo[109965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc Aug 26 16:24:48 devstack sudo[109965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:48 devstack sudo[109965]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc" returned: 0 in 0.316s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:24:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce50692-598e-4241-a9c0-0b03868c2773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b6aacd-17ea-4c23-9339-1354c8bea803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:48 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Volume volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc (a2ab0c73-d762-47ce-a21a-f5bca37e84cc): created successfully Aug 26 16:24:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b6aacd-17ea-4c23-9339-1354c8bea803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Flow 'volume_create_manager' (712ae569-5e97-41be-a3d1-1004c78c9584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:48 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f4c8c694-82da-4d78-80b3-a6dfaf51186f tempest-VolumesTransfersV355Test-1884984293 None] Created volume successfully. Aug 26 16:24:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Acquiring lock "cinder-a2ab0c73-d762-47ce-a21a-f5bca37e84cc-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Lock "cinder-a2ab0c73-d762-47ce-a21a-f5bca37e84cc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Acquiring lock "cinder-quobyte-a2ab0c73-d762-47ce-a21a-f5bca37e84cc" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:24:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Lock "cinder-quobyte-a2ab0c73-d762-47ce-a21a-f5bca37e84cc" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:24:49 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ae0dfc-6f35-4fd5-97d8-2996542bb2b0]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:49 devstack sudo[109981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc Aug 26 16:24:49 devstack sudo[109981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:50 devstack sudo[109981]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc" returned: 0 in 0.577s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:50 devstack sudo[109990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc Aug 26 16:24:50 devstack sudo[109990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:50 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-198b9c16-1183-499a-9b45-765cac185a98 req-d198b1b7-e55c-4826-b103-0a67163ca7ea tempest-TestStampPattern-600342741 None] Terminate volume connection completed successfully. Aug 26 16:24:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-198b9c16-1183-499a-9b45-765cac185a98 req-d198b1b7-e55c-4826-b103-0a67163ca7ea tempest-TestStampPattern-600342741 None] Deleting attachment 367ac3fc-1007-4ba9-9c7a-d5367fb60d22. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:24:50 devstack sudo[109990]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a2ab0c73-d762-47ce-a21a-f5bca37e84cc" returned: 0 in 0.367s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Lock "cinder-quobyte-a2ab0c73-d762-47ce-a21a-f5bca37e84cc" released by "delete_volume" :: held 1.034s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:50 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Created reservations ['13efe6b2-e0c9-48af-867a-10892eb6c320', '1353a2bf-b136-4925-a4b7-3e8a194639e0', '5e29bea9-689c-4cc5-890a-6fc0ee4c1554', '0d8380e4-d4c7-47b6-a362-a7e14a939b92'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:24:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:50 devstack sudo[110020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:24:50 devstack sudo[110020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:51 devstack sudo[110020]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.292s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:51 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:24:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Deleted volume successfully. Aug 26 16:24:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cdab10b1-2d6c-47de-8f2e-bc22331cb150 tempest-VolumesTransfersV355Test-817008250 None] Lock "cinder-a2ab0c73-d762-47ce-a21a-f5bca37e84cc-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:24:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] Creating offline snapshot bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 of volume c0e7272f-24f5-4854-9a8a-600908c80f1f {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:24:51 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd434608-53c5-4893-ba66-5182d213cd0d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:24:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:51 devstack sudo[110023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f Aug 26 16:24:51 devstack sudo[110023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:52 devstack sudo[110023]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f" returned: 0 in 0.526s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:52 devstack sudo[110028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 1G Aug 26 16:24:52 devstack sudo[110028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:52 devstack sudo[110028]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 1G" returned: 0 in 0.568s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0e7272f-24f5-4854-9a8a-600908c80f1f -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:52 devstack sudo[110034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0e7272f-24f5-4854-9a8a-600908c80f1f -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 Aug 26 16:24:52 devstack sudo[110034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:53 devstack sudo[110034]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0e7272f-24f5-4854-9a8a-600908c80f1f -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73" returned: 0 in 0.448s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:53 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 is being set with open permissions: ugo+rw Aug 26 16:24:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:53 devstack sudo[110039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 Aug 26 16:24:53 devstack sudo[110039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:53 devstack sudo[110039]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73" returned: 0 in 0.286s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:53 devstack sudo[110042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.info Aug 26 16:24:53 devstack sudo[110042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:53 devstack sudo[110042]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.info" returned: 0 in 0.527s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:53 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.info is being set with open permissions: ugo+rw Aug 26 16:24:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:53 devstack sudo[110045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.info Aug 26 16:24:53 devstack sudo[110045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:53 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Flow 'volume_create_manager' (f6d9795a-0f64-4a71-9387-549fba6c44db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f65dd5-27d7-4826-9bb7-536ab23d93e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f65dd5-27d7-4826-9bb7-536ab23d93e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-181225284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb30e02-a91b-4473-943d-6e427801bb06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1049e8f91164d228fae549716afa0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:54Z,use_quota=True,user_id='b06d7f04c28a43f0b90ed70c3b1ce6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8260387-8466-48c1-91cc-4490dda30ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8260387-8466-48c1-91cc-4490dda30ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f90c49-1b9b-4f29-aaae-1c7a4f6b7760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f90c49-1b9b-4f29-aaae-1c7a4f6b7760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb30e02-a91b-4473-943d-6e427801bb06', 'volume_name': 'volume-5bb30e02-a91b-4473-943d-6e427801bb06', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5439e5b-dcb9-49a4-88b4-0942a86ba422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5439e5b-dcb9-49a4-88b4-0942a86ba422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d7438c-3d7f-4ec8-a5af-56bda02902b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:54 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Volume 5bb30e02-a91b-4473-943d-6e427801bb06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb30e02-a91b-4473-943d-6e427801bb06', 'volume_size': 1} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:54 devstack sudo[110045]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.info" returned: 0 in 0.397s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.894s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.216s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-181225284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb30e02-a91b-4473-943d-6e427801bb06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1049e8f91164d228fae549716afa0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:54Z,use_quota=True,user_id='b06d7f04c28a43f0b90ed70c3b1ce6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Creating volume 5bb30e02-a91b-4473-943d-6e427801bb06 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:24:54 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5bb30e02-a91b-4473-943d-6e427801bb06 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:54 devstack sudo[110049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5bb30e02-a91b-4473-943d-6e427801bb06 1073741824 Aug 26 16:24:54 devstack sudo[110049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:54 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-20c386e2-5498-43e9-ac3b-f4f2e9f79d57 tempest-TestStampPattern-600342741 None] Create snapshot completed successfully Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Flow 'volume_create_manager' (c3a2f3ee-b1dc-47b2-a287-0f0a48fbb75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f70e5dd-6c0c-422d-ade3-92677aa75760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f70e5dd-6c0c-422d-ade3-92677aa75760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1388913963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac6d376-79a5-4f22-8297-2cf4bf473c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1049e8f91164d228fae549716afa0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:55Z,use_quota=True,user_id='b06d7f04c28a43f0b90ed70c3b1ce6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a757c37d-cd06-4552-8143-f0eb2f321da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a757c37d-cd06-4552-8143-f0eb2f321da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a0870e-c49e-4bee-92f8-4b42718e0019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a0870e-c49e-4bee-92f8-4b42718e0019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac6d376-79a5-4f22-8297-2cf4bf473c9f', 'volume_name': 'volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d105b85-46cf-40af-a55d-82ca61e971d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d105b85-46cf-40af-a55d-82ca61e971d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414e07ae-a962-4d26-898e-3b72a32bc29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:54 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Volume 0ac6d376-79a5-4f22-8297-2cf4bf473c9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f', 'volume_size': 1} Aug 26 16:24:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:55 devstack sudo[110049]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5bb30e02-a91b-4473-943d-6e427801bb06 1073741824" returned: 0 in 0.802s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5bb30e02-a91b-4473-943d-6e427801bb06 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:55 devstack sudo[110055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5bb30e02-a91b-4473-943d-6e427801bb06 Aug 26 16:24:55 devstack sudo[110055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:55 devstack sudo[110055]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5bb30e02-a91b-4473-943d-6e427801bb06" returned: 0 in 0.314s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1388913963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac6d376-79a5-4f22-8297-2cf4bf473c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1049e8f91164d228fae549716afa0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:24:55Z,use_quota=True,user_id='b06d7f04c28a43f0b90ed70c3b1ce6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Creating volume 0ac6d376-79a5-4f22-8297-2cf4bf473c9f {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:24:55 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d7438c-3d7f-4ec8-a5af-56bda02902b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb30e02-a91b-4473-943d-6e427801bb06', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:55 devstack sudo[110058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f 1073741824 Aug 26 16:24:55 devstack sudo[110058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab37236-96d6-4a09-b037-bf97d9afd539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:55 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Volume volume-5bb30e02-a91b-4473-943d-6e427801bb06 (5bb30e02-a91b-4473-943d-6e427801bb06): created successfully Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab37236-96d6-4a09-b037-bf97d9afd539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Flow 'volume_create_manager' (f6d9795a-0f64-4a71-9387-549fba6c44db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-4a370df3-b528-46f1-9f47-6d51009aafe8 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Created volume successfully. Aug 26 16:24:56 devstack sudo[110058]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f 1073741824" returned: 0 in 0.668s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:24:56 devstack sudo[110064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f Aug 26 16:24:56 devstack sudo[110064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:24:56 devstack sudo[110064]: pam_unix(sudo:session): session closed for user root Aug 26 16:24:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f" returned: 0 in 0.323s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:24:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:24:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:24:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414e07ae-a962-4d26-898e-3b72a32bc29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d327a667-3f44-448b-a219-2626140b99f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:24:56 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Volume volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f (0ac6d376-79a5-4f22-8297-2cf4bf473c9f): created successfully Aug 26 16:24:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d327a667-3f44-448b-a219-2626140b99f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:24:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Flow 'volume_create_manager' (c3a2f3ee-b1dc-47b2-a287-0f0a48fbb75f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:24:56 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-56196956-d6bc-4ffa-9334-ecf7fd260888 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Created volume successfully. Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Flow 'volume_create_manager' (f1f30bcc-83bb-423a-bd09-caad511e1182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14ac7c9-13ea-4431-a12e-c714b06f07f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14ac7c9-13ea-4431-a12e-c714b06f07f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-818448205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7639ec25-1d4e-4bc4-b7fa-a0aff7485a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a23b24fb2bf407fae9f1fb1e301035c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:25:04Z,use_quota=True,user_id='fba70ddb24f441ef8a8bbbb2f4ea8a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad61c57f-315d-469b-a34f-5dcae98bc2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad61c57f-315d-469b-a34f-5dcae98bc2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36802346-7ec7-43c6-881a-9f8c280abf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36802346-7ec7-43c6-881a-9f8c280abf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7639ec25-1d4e-4bc4-b7fa-a0aff7485a99', 'volume_name': 'volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7058e5fb-0be2-4e00-81c7-21e290618506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7058e5fb-0be2-4e00-81c7-21e290618506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45706a8-7605-4528-bfbd-cb2caaac5aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:04 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Volume 7639ec25-1d4e-4bc4-b7fa-a0aff7485a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99', 'volume_size': 1} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-818448205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7639ec25-1d4e-4bc4-b7fa-a0aff7485a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a23b24fb2bf407fae9f1fb1e301035c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:25:04Z,use_quota=True,user_id='fba70ddb24f441ef8a8bbbb2f4ea8a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Creating volume 7639ec25-1d4e-4bc4-b7fa-a0aff7485a99 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:25:04 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:04 devstack sudo[110133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99 1073741824 Aug 26 16:25:04 devstack sudo[110133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Flow 'volume_create_manager' (e8901041-3b91-47a6-955e-deaf139d324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dcee094-dde7-41c4-b99e-05e5f05da47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dcee094-dde7-41c4-b99e-05e5f05da47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1423730335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08eb3d0f-3688-47df-92ea-c80e3f0c7a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba16ea30a3b4a67979bd2d88e83572f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bb3656ba-ed6e-435d-aeb5-7f0e7453fc73,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:25:05Z,use_quota=True,user_id='fbc57b4c111a4cd38d2b3cd73d6ae24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec66de5-23c9-44dc-af6f-75633e178db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec66de5-23c9-44dc-af6f-75633e178db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e75cd7-6900-41f7-b5bf-c4c5436faad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e75cd7-6900-41f7-b5bf-c4c5436faad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '08eb3d0f-3688-47df-92ea-c80e3f0c7a7f', 'volume_name': 'volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f', 'volume_size': 1, 'snapshot_id': 'bb3656ba-ed6e-435d-aeb5-7f0e7453fc73'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeefcbf5-44b4-44a0-828a-69932450795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeefcbf5-44b4-44a0-828a-69932450795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61044e23-6ea2-41a9-8de1-75ecea075abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:04 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Volume 08eb3d0f-3688-47df-92ea-c80e3f0c7a7f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f', 'volume_size': 1, 'snapshot_id': 'bb3656ba-ed6e-435d-aeb5-7f0e7453fc73'} Aug 26 16:25:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:05 devstack sudo[110133]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99 1073741824" returned: 0 in 0.682s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:05 devstack sudo[110139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99 Aug 26 16:25:05 devstack sudo[110139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:05 devstack sudo[110139]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99" returned: 0 in 0.315s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.723s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Acquiring lock "cinder-quobyte-bb3656ba-ed6e-435d-aeb5-7f0e7453fc73-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f" by "_create_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45706a8-7605-4528-bfbd-cb2caaac5aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e31bc8-78b4-426e-9468-e184e82cb349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Lock "cinder-quobyte-bb3656ba-ed6e-435d-aeb5-7f0e7453fc73-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Creating volume 08eb3d0f-3688-47df-92ea-c80e3f0c7a7f from snapshot bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 {{(pid=94407) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Acquiring lock "cinder-quobyte-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f" by "_copy_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Lock "cinder-quobyte-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] snapshot: bb3656ba-ed6e-435d-aeb5-7f0e7453fc73, volume: 08eb3d0f-3688-47df-92ea-c80e3f0c7a7f, {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 16:25:05 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Volume volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99 (7639ec25-1d4e-4bc4-b7fa-a0aff7485a99): created successfully Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e31bc8-78b4-426e-9468-e184e82cb349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Flow 'volume_create_manager' (f1f30bcc-83bb-423a-bd09-caad511e1182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:25:05 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-fced6c2e-503c-4857-a157-bc69095b7a0f tempest-VolumesTransfersV357Test-688271804 None] Created volume successfully. Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[560920ff-c587-4292-92c3-0d473cf4e082]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:25:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:06 devstack sudo[110142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 Aug 26 16:25:06 devstack sudo[110142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:06 devstack sudo[110142]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73" returned: 0 in 0.578s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0e7272f-24f5-4854-9a8a-600908c80f1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:25:06 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c9aeee-7719-4e88-8380-1caababb7364]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:25:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:06 devstack sudo[110148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f Aug 26 16:25:06 devstack sudo[110148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:07 devstack sudo[110148]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f" returned: 0 in 0.594s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] will copy from snapshot at /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 16:25:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Creating direct copy from snapshot {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 16:25:07 devstack cinder-volume[94407]: DEBUG cinder.utils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Path /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f not found in is_blk_device check {{(pid=94407) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 16:25:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:07 devstack sudo[110153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f Aug 26 16:25:07 devstack sudo[110153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:07 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b3c1b98b-3fe0-4664-9303-7ef21a3f3f35 tempest-VolumesTransfersV357Test-958843043 None] Transfer volume completed successfully. Aug 26 16:25:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Acquiring lock "cinder-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:25:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Lock "cinder-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:25:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Acquiring lock "cinder-quobyte-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:25:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Lock "cinder-quobyte-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99" acquired by "delete_volume" :: waited 0.046s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:25:09 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdf0a89-20b2-4615-b7a1-e4ab43a0e281]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:25:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:10 devstack sudo[110172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99 Aug 26 16:25:10 devstack sudo[110172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:11 devstack sudo[110172]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99" returned: 0 in 1.463s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:11 devstack sudo[110227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99 Aug 26 16:25:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:11 devstack sudo[110227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:12 devstack sudo[110227]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99" returned: 0 in 1.087s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Lock "cinder-quobyte-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99" released by "delete_volume" :: held 2.716s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:25:12 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Created reservations ['bd9aec2a-fc38-40df-a6b1-89d53a519056', '46ec8ce8-9169-4fcd-8b23-c4e18ddc8d0a', 'a897d9bd-4eae-460b-b4da-653dbd4caa74', 'fb8edf92-2271-45a3-a7a1-ddcb584f20d5'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:25:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:25:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:25:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:13 devstack sudo[110613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:25:13 devstack sudo[110613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:13 devstack sudo[110613]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.928s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:13 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:25:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Deleted volume successfully. Aug 26 16:25:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df9b298a-d435-43f6-b66d-e270c11a58d6 tempest-VolumesTransfersV357Test-1408887137 None] Lock "cinder-7639ec25-1d4e-4bc4-b7fa-a0aff7485a99-delete_volume" released by "delete_volume" :: held 4.482s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:25:15 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:25:15 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Flow 'volume_create_manager' (25a5c92c-def3-4db8-a805-a2f13e43b5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:25:15 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1757044-95bf-4df1-a8de-598daab0095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:15 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1757044-95bf-4df1-a8de-598daab0095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-524291579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3c1f5a-f6d6-4091-8b9e-748d5177e86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a23b24fb2bf407fae9f1fb1e301035c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:25:16Z,use_quota=True,user_id='fba70ddb24f441ef8a8bbbb2f4ea8a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4688898b-7c69-46bf-826a-f264dd519fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4688898b-7c69-46bf-826a-f264dd519fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ed8369-ad0c-4304-9679-429fb3a5dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ed8369-ad0c-4304-9679-429fb3a5dea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3c1f5a-f6d6-4091-8b9e-748d5177e86a', 'volume_name': 'volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181a62ec-38f9-48d4-9efe-61d66015fd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181a62ec-38f9-48d4-9efe-61d66015fd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a172968-e614-4f14-bd5b-dc9234b8b79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:16 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Volume ad3c1f5a-f6d6-4091-8b9e-748d5177e86a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a', 'volume_size': 1} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:16 devstack sudo[110153]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f" returned: 0 in 9.137s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f, size 1024.00 MB, duration 9.14 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:25:16 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Converted 1024.00 MB image at 112.06 MB/s Aug 26 16:25:16 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f is being set with open permissions: ugo+rw Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:16 devstack sudo[110684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f Aug 26 16:25:16 devstack sudo[110684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:16 devstack sudo[110684]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f" returned: 0 in 0.571s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Lock "cinder-quobyte-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f" released by "_copy_volume_from_snapshot" :: held 11.073s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Lock "cinder-quobyte-bb3656ba-ed6e-435d-aeb5-7f0e7453fc73-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f" released by "_create_volume_from_snapshot" :: held 11.194s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.244s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.894s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-524291579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3c1f5a-f6d6-4091-8b9e-748d5177e86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a23b24fb2bf407fae9f1fb1e301035c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:25:16Z,use_quota=True,user_id='fba70ddb24f441ef8a8bbbb2f4ea8a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Creating volume ad3c1f5a-f6d6-4091-8b9e-748d5177e86a {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:25:16 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:25:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:17 devstack sudo[110688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a 1073741824 Aug 26 16:25:17 devstack sudo[110688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61044e23-6ea2-41a9-8de1-75ecea075abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f', 'volume_size': 1, 'snapshot_id': 'bb3656ba-ed6e-435d-aeb5-7f0e7453fc73'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ef87fa-2e14-42d9-aee9-945d7f6297f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:17 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Volume volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f (08eb3d0f-3688-47df-92ea-c80e3f0c7a7f): created successfully Aug 26 16:25:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ef87fa-2e14-42d9-aee9-945d7f6297f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Flow 'volume_create_manager' (e8901041-3b91-47a6-955e-deaf139d324d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:25:17 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f2520f7f-b53a-4b41-9411-59e6289e1736 tempest-TestStampPattern-600342741 None] Created volume successfully. Aug 26 16:25:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:25:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:25:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:25:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:18 devstack sudo[110694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:25:18 devstack sudo[110694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:18 devstack sudo[110688]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a 1073741824" returned: 0 in 1.111s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:18 devstack sudo[110696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a Aug 26 16:25:18 devstack sudo[110696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:18 devstack sudo[110694]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.418s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 28 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:25:18 devstack sudo[110696]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a" returned: 0 in 0.554s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a172968-e614-4f14-bd5b-dc9234b8b79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06fa0b65-a5c2-4d9a-ad5b-46c931b315ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:18 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Volume volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a (ad3c1f5a-f6d6-4091-8b9e-748d5177e86a): created successfully Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06fa0b65-a5c2-4d9a-ad5b-46c931b315ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Flow 'volume_create_manager' (25a5c92c-def3-4db8-a805-a2f13e43b5e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:25:18 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e112cd7a-7de9-4fe5-b60f-67fe26d078b4 tempest-VolumesTransfersV357Test-688271804 None] Created volume successfully. Aug 26 16:25:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Acquiring lock "cinder-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:25:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Lock "cinder-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:25:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Acquiring lock "cinder-quobyte-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:25:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Lock "cinder-quobyte-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a" acquired by "delete_volume" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:25:20 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5accff-d51b-4ceb-ac53-978d49b5f40a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:25:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:20 devstack sudo[110726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a Aug 26 16:25:20 devstack sudo[110726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:21 devstack sudo[110726]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a" returned: 0 in 0.518s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:21 devstack sudo[110733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a Aug 26 16:25:21 devstack sudo[110733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:21 devstack sudo[110733]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a" returned: 0 in 0.284s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Lock "cinder-quobyte-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a" released by "delete_volume" :: held 0.853s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:25:21 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Created reservations ['1d28d53d-8708-4059-83fc-614d35db00a4', 'fbc5dbc9-7bf9-416d-b186-67e03470cebb', 'b47a9383-2e61-438c-a9b5-13e879a30911', '061e483f-be4c-44ea-bbe2-7969a20e9e4d'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:25:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:25:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:25:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:21 devstack sudo[110737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:25:21 devstack sudo[110737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:22 devstack sudo[110737]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.766s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:22 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:25:22 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Deleted volume successfully. Aug 26 16:25:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fecc9716-8da4-4e61-a417-a8bd09b650eb tempest-VolumesTransfersV357Test-1408887137 None] Lock "cinder-ad3c1f5a-f6d6-4091-8b9e-748d5177e86a-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=50,cinder:UPDATE=54,cinder:DELETE=4,cinder:INSERT=9 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Flow 'volume_create_manager' (ea7c94a7-a514-42e1-a852-602084aef50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a8e705-afbf-4993-b582-0fd1a19f04ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a8e705-afbf-4993-b582-0fd1a19f04ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1561419353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b8d6b8-75b3-4db2-afd9-40cae269bc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394bf159472d480bbba1001fd2d74063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:25:32Z,use_quota=True,user_id='c2f1902c57494d20ae2d2fb11815d076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0450b71d-16bb-4443-84f1-cd98b96c544f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0450b71d-16bb-4443-84f1-cd98b96c544f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddc1b99-5b3e-4cc6-9517-5ad49e34e4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddc1b99-5b3e-4cc6-9517-5ad49e34e4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b8d6b8-75b3-4db2-afd9-40cae269bc11', 'volume_name': 'volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ed1d6d-2f52-46dd-9caf-b95a31781a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ed1d6d-2f52-46dd-9caf-b95a31781a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6ba546-90bb-4a7f-b1c8-fd3aad4af96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:31 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Volume 67b8d6b8-75b3-4db2-afd9-40cae269bc11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11', 'volume_size': 1} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1561419353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b8d6b8-75b3-4db2-afd9-40cae269bc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394bf159472d480bbba1001fd2d74063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:25:32Z,use_quota=True,user_id='c2f1902c57494d20ae2d2fb11815d076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Creating volume 67b8d6b8-75b3-4db2-afd9-40cae269bc11 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:25:31 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:25:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:32 devstack sudo[110856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 1073741824 Aug 26 16:25:32 devstack sudo[110856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:32 devstack sudo[110856]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 1073741824" returned: 0 in 0.749s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:32 devstack sudo[110862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 Aug 26 16:25:32 devstack sudo[110862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Flow 'volume_create_manager' (8ff4c350-6d75-4312-b91c-4765c700cf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d82feca-332c-42ae-8a3f-0605c670f58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:33 devstack sudo[110862]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d82feca-332c-42ae-8a3f-0605c670f58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-447382549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22626341-2601-475d-ad7e-0b40efda81cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b04e35633c4de5b60f902eb9cbbd32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:25:33Z,use_quota=True,user_id='4f8390caf635491d8d64bba93b54faa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca59c64-c3a5-4e75-bec5-27929ea1558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca59c64-c3a5-4e75-bec5-27929ea1558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aff2c1f-4b00-42c4-b204-fc333bccec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.image.glance [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Creating Keystone auth plugin from conf {{(pid=94407) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11" returned: 0 in 0.388s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6ba546-90bb-4a7f-b1c8-fd3aad4af96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adb4555-ebe0-49ce-934e-47bdd4e9bba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:33 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Volume volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 (67b8d6b8-75b3-4db2-afd9-40cae269bc11): created successfully Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adb4555-ebe0-49ce-934e-47bdd4e9bba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Flow 'volume_create_manager' (ea7c94a7-a514-42e1-a852-602084aef50b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:25:33 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-fd78a080-41a8-4a81-9564-1d757a91225c tempest-TestImageHashVerification-1499087710 None] Created volume successfully. Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aff2c1f-4b00-42c4-b204-fc333bccec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '22626341-2601-475d-ad7e-0b40efda81cb', 'volume_name': 'volume-22626341-2601-475d-ad7e-0b40efda81cb', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24295105-ff3f-4ebd-a857-b0432e153ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24295105-ff3f-4ebd-a857-b0432e153ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5368e1a-7a27-4e23-b075-a582a0a9d7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:33 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Volume 22626341-2601-475d-ad7e-0b40efda81cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-22626341-2601-475d-ad7e-0b40efda81cb', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Trying to clone 22626341-2601-475d-ad7e-0b40efda81cb from image 6ac3a618-4ad2-4833-9626-12a425ebacfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]). {{(pid=94407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 16:25:33 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 16:25:33 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Image download 20.69 MB at 20.69 MB/s Aug 26 16:25:34 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bc2eaa-2be0-4a4d-a9bd-517856b148d2]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:25:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:34 devstack sudo[110867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD Aug 26 16:25:34 devstack sudo[110867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:34 devstack sudo[110867]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:34 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Temporary image 6ac3a618-4ad2-4833-9626-12a425ebacfd is fetched for user 4f8390caf635491d8d64bba93b54faa9. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 16:25:34 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcaef9a-db7b-4cb5-b022-0f967d5392eb]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:25:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:34 devstack sudo[110875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD Aug 26 16:25:34 devstack sudo[110875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:35 devstack sudo[110875]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-447382549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22626341-2601-475d-ad7e-0b40efda81cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b04e35633c4de5b60f902eb9cbbd32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:25:33Z,use_quota=True,user_id='4f8390caf635491d8d64bba93b54faa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Creating volume 22626341-2601-475d-ad7e-0b40efda81cb {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:25:35 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:35 devstack sudo[110881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb 1073741824 Aug 26 16:25:35 devstack sudo[110881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:35 devstack sudo[110881]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb 1073741824" returned: 0 in 0.495s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:35 devstack sudo[110887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb Aug 26 16:25:35 devstack sudo[110887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:35 devstack sudo[110887]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb" returned: 0 in 0.276s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.557s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51a8885-77bd-4d47-b78a-a8bb507d6ea4]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Attempting download of 6ac3a618-4ad2-4833-9626-12a425ebacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}])) to volume 22626341-2601-475d-ad7e-0b40efda81cb. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[7971bc19-34cc-4ebd-8c96-d1067adba699]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:25:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_myt03vu0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:36 devstack sudo[110893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 Aug 26 16:25:36 devstack sudo[110893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:36 devstack sudo[110897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_myt03vu0 Aug 26 16:25:36 devstack sudo[110897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:36 devstack sudo[110893]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11" returned: 0 in 0.556s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:36 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24633e2-f810-4f32-a660-3f8bef2f01c9]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:25:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:36 devstack sudo[110897]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_myt03vu0" returned: 0 in 0.544s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_myt03vu0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:36 devstack sudo[110903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 Aug 26 16:25:36 devstack sudo[110903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:36 devstack sudo[110906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_myt03vu0 Aug 26 16:25:36 devstack sudo[110906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:36 devstack sudo[110906]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_myt03vu0" returned: 1 in 0.343s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_myt03vu0' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:25:36 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cfecf1-5d68-4303-85e2-5b95ab9df640]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:25:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:36 devstack sudo[110903]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11" returned: 0 in 0.429s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 /opt/stack/data/cinder/conversion/67b8d6b8-75b3-4db2-afd9-40cae269bc11.temp_image.f4d90708-6e07-499b-a5cc-183bd28628a8ebq7q272.img {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:36 devstack sudo[110915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 /opt/stack/data/cinder/conversion/67b8d6b8-75b3-4db2-afd9-40cae269bc11.temp_image.f4d90708-6e07-499b-a5cc-183bd28628a8ebq7q272.img Aug 26 16:25:36 devstack sudo[110915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:37 devstack sudo[110914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD Aug 26 16:25:37 devstack sudo[110914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:37 devstack sudo[110914]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD" returned: 0 in 0.414s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:37 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] 6ac3a618-4ad2-4833-9626-12a425ebacfd was qcow2, converting to qcow2 {{(pid=94407) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 16:25:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:37 devstack sudo[110932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb Aug 26 16:25:37 devstack sudo[110932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:41 devstack sudo[110932]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb" returned: 0 in 4.420s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:41 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_mb909559devstack@QuobyteHD, size 112.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:25:41 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Converted 112.00 MB image at 25.33 MB/s Aug 26 16:25:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:41 devstack sudo[110958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb 1G Aug 26 16:25:41 devstack sudo[110958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:42 devstack sudo[110915]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 /opt/stack/data/cinder/conversion/67b8d6b8-75b3-4db2-afd9-40cae269bc11.temp_image.f4d90708-6e07-499b-a5cc-183bd28628a8ebq7q272.img" returned: 0 in 5.359s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdca5b4-cabb-49c6-a6c1-f8f77542a953]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:25:42 devstack sudo[110958]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb 1G" returned: 0 in 0.590s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Downloaded image 6ac3a618-4ad2-4833-9626-12a425ebacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}])) to volume 22626341-2601-475d-ad7e-0b40efda81cb successfully. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Temporary image 6ac3a618-4ad2-4833-9626-12a425ebacfd for user 4f8390caf635491d8d64bba93b54faa9 is deleted. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Marking volume 22626341-2601-475d-ad7e-0b40efda81cb as bootable. {{(pid=94407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Copying metadata from image 6ac3a618-4ad2-4833-9626-12a425ebacfd to 22626341-2601-475d-ad7e-0b40efda81cb. {{(pid=94407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Creating volume glance metadata for volume 22626341-2601-475d-ad7e-0b40efda81cb backed by image 6ac3a618-4ad2-4833-9626-12a425ebacfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=68,cinder:SELECT=51,cinder:INSERT=16,cinder:DELETE=9 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:25:42 devstack sudo[110966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 Aug 26 16:25:42 devstack sudo[110966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5368e1a-7a27-4e23-b075-a582a0a9d7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22626341-2601-475d-ad7e-0b40efda81cb', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d612b6-44b6-4008-9c5e-c309f8d331fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:25:42 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Volume volume-22626341-2601-475d-ad7e-0b40efda81cb (22626341-2601-475d-ad7e-0b40efda81cb): created successfully Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d612b6-44b6-4008-9c5e-c309f8d331fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Flow 'volume_create_manager' (8ff4c350-6d75-4312-b91c-4765c700cf8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:25:42 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2828804a-8092-454e-8651-26111b51ed3d tempest-VolumesExtendTest-331690909 None] Created volume successfully. Aug 26 16:25:42 devstack sudo[110966]: pam_unix(sudo:session): session closed for user root Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11" returned: 0 in 0.612s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/conversion/67b8d6b8-75b3-4db2-afd9-40cae269bc11.temp_image.f4d90708-6e07-499b-a5cc-183bd28628a8ebq7q272.img {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:25:42 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] Converted 1024.00 MB image at 191.03 MB/s Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-39232a95-1b12-400d-981f-04c51f10ee15 req-b53e78d5-1b81-4d00-8a2c-8280a410dc45 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:42 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] f4d90708-6e07-499b-a5cc-183bd28628a8 was raw, no need to convert to raw {{(pid=94407) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 16:25:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-91fc8e18-e311-4816-bcf6-b30f9a4a41db tempest-VolumesExtendTest-331690909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:25:52 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=17,cinder:INSERT=12,cinder:UPDATE=5 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:25:52 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:INSERT=2,cinder:SELECT=6,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:25:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-d1f73fbe-70e0-4ca8-8432-076ae13611db req-cba67d1c-50fc-46c2-a543-793cf9eaca94 tempest-TestStampPattern-600342741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.600s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] Uploaded volume to glance image-id: f4d90708-6e07-499b-a5cc-183bd28628a8. {{(pid=94407) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 16:26:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-39232a95-1b12-400d-981f-04c51f10ee15 req-b53e78d5-1b81-4d00-8a2c-8280a410dc45 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 18.555s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-39232a95-1b12-400d-981f-04c51f10ee15 req-b53e78d5-1b81-4d00-8a2c-8280a410dc45 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-91fc8e18-e311-4816-bcf6-b30f9a4a41db tempest-VolumesExtendTest-331690909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 17.979s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0ae1ab91-4480-488e-84db-43d99a579c63 tempest-TestImageHashVerification-1499087710 None] Copy volume to image completed successfully. Aug 26 16:26:01 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce294100-6e83-4363-b4e1-8c50751dbc7f]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-91fc8e18-e311-4816-bcf6-b30f9a4a41db tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-39232a95-1b12-400d-981f-04c51f10ee15 req-b53e78d5-1b81-4d00-8a2c-8280a410dc45 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-5bb30e02-a91b-4473-943d-6e427801bb06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ed53d61-802e-4dbe-8046-bf3b9215239e', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:26:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-39232a95-1b12-400d-981f-04c51f10ee15 req-b53e78d5-1b81-4d00-8a2c-8280a410dc45 tempest-TestServerVolumeAttachmentScenario-1887517869 None] attachment_update completed successfully. Aug 26 16:26:01 devstack sudo[111000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb Aug 26 16:26:01 devstack sudo[111000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:02 devstack sudo[111000]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-91fc8e18-e311-4816-bcf6-b30f9a4a41db tempest-VolumesExtendTest-331690909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb" returned: 0 in 0.546s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-91fc8e18-e311-4816-bcf6-b30f9a4a41db tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb 2G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-91fc8e18-e311-4816-bcf6-b30f9a4a41db tempest-VolumesExtendTest-331690909 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb 2G" returned: 0 in 0.117s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-91fc8e18-e311-4816-bcf6-b30f9a4a41db tempest-VolumesExtendTest-331690909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.685s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-d1f73fbe-70e0-4ca8-8432-076ae13611db req-cba67d1c-50fc-46c2-a543-793cf9eaca94 tempest-TestStampPattern-600342741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.055s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-d1f73fbe-70e0-4ca8-8432-076ae13611db req-cba67d1c-50fc-46c2-a543-793cf9eaca94 tempest-TestStampPattern-600342741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-d1f73fbe-70e0-4ca8-8432-076ae13611db req-cba67d1c-50fc-46c2-a543-793cf9eaca94 tempest-TestStampPattern-600342741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da2bc8ee-94f1-4780-b169-3e74768ee788', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:26:02 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-91fc8e18-e311-4816-bcf6-b30f9a4a41db tempest-VolumesExtendTest-331690909 None] Extend volume completed successfully. Aug 26 16:26:02 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-d1f73fbe-70e0-4ca8-8432-076ae13611db req-cba67d1c-50fc-46c2-a543-793cf9eaca94 tempest-TestStampPattern-600342741 None] attachment_update completed successfully. Aug 26 16:26:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Acquiring lock "cinder-67b8d6b8-75b3-4db2-afd9-40cae269bc11-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Lock "cinder-67b8d6b8-75b3-4db2-afd9-40cae269bc11-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Acquiring lock "cinder-quobyte-67b8d6b8-75b3-4db2-afd9-40cae269bc11" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Lock "cinder-quobyte-67b8d6b8-75b3-4db2-afd9-40cae269bc11" acquired by "delete_volume" :: waited 0.039s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:02 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a885d1-c17c-44ae-8ee4-ab95020daa33]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:03 devstack sudo[111419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 Aug 26 16:26:03 devstack sudo[111419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Acquiring lock "cinder-22626341-2601-475d-ad7e-0b40efda81cb-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Lock "cinder-22626341-2601-475d-ad7e-0b40efda81cb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Acquiring lock "cinder-quobyte-22626341-2601-475d-ad7e-0b40efda81cb" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Lock "cinder-quobyte-22626341-2601-475d-ad7e-0b40efda81cb" acquired by "delete_volume" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2d7726-44cb-4bfe-a330-130457139f3e]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:03 devstack sudo[111419]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11" returned: 0 in 0.608s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:03 devstack sudo[111426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11 Aug 26 16:26:03 devstack sudo[111426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:03 devstack sudo[111425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb Aug 26 16:26:03 devstack sudo[111425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:03 devstack sudo[111426]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-67b8d6b8-75b3-4db2-afd9-40cae269bc11" returned: 0 in 0.256s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Lock "cinder-quobyte-67b8d6b8-75b3-4db2-afd9-40cae269bc11" released by "delete_volume" :: held 0.929s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Created reservations ['3c858299-bb0a-446c-b174-2cb2eda266e8', '2dbe221a-3bfb-4009-9eee-327d324d3e4d', 'e26500bd-dd16-43a4-8946-bea38acfa2f5', '89eb9be9-66bc-4a35-a3c8-e636ba51a6a3'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:03 devstack sudo[111425]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb" returned: 0 in 0.397s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:03 devstack sudo[111434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb Aug 26 16:26:03 devstack sudo[111434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:03 devstack sudo[111436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:03 devstack sudo[111436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:04 devstack sudo[111434]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-22626341-2601-475d-ad7e-0b40efda81cb" returned: 0 in 0.294s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Lock "cinder-quobyte-22626341-2601-475d-ad7e-0b40efda81cb" released by "delete_volume" :: held 0.759s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Created reservations ['f52ae579-1266-45cf-a706-25fd14f90380', 'c3356652-d3b2-4873-8944-1935041463c5', '0ad0d666-5646-4f31-ad84-8b94b0a4ed25', '5a959892-9c08-44cb-aa9d-b3c71e0b3103'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:04 devstack sudo[111436]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.361s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:04 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Deleted volume successfully. Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-70a5bb5c-871f-4d69-a8a4-3fcc2ed1bb1c tempest-TestImageHashVerification-1499087710 None] Lock "cinder-67b8d6b8-75b3-4db2-afd9-40cae269bc11-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:04 devstack sudo[111444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:04 devstack sudo[111444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:04 devstack sudo[111444]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.323s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:04 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Deleted volume successfully. Aug 26 16:26:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ae918b85-fe77-4a82-bec8-952a945656de tempest-VolumesExtendTest-331690909 None] Lock "cinder-22626341-2601-475d-ad7e-0b40efda81cb-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Flow 'volume_create_manager' (e7940b53-2784-4f95-a319-80761018cace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60f670c-1d68-42e0-8a9e-13824bea567c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60f670c-1d68-42e0-8a9e-13824bea567c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1363903134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba31ba4-0a7b-42de-ba09-51c779dbd6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b04e35633c4de5b60f902eb9cbbd32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:05Z,use_quota=True,user_id='4f8390caf635491d8d64bba93b54faa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6026b1eb-565e-4805-8cc6-ef296956a1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6026b1eb-565e-4805-8cc6-ef296956a1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8045f179-20e8-4502-991b-fb8c2bfb70d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8045f179-20e8-4502-991b-fb8c2bfb70d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba31ba4-0a7b-42de-ba09-51c779dbd6cc', 'volume_name': 'volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f871f8a3-7a08-468c-9da5-702722afd6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f871f8a3-7a08-468c-9da5-702722afd6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9b6ce7-0074-4033-996f-e7448fec121c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:05 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Volume 6ba31ba4-0a7b-42de-ba09-51c779dbd6cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc', 'volume_size': 1} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1363903134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba31ba4-0a7b-42de-ba09-51c779dbd6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b04e35633c4de5b60f902eb9cbbd32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:05Z,use_quota=True,user_id='4f8390caf635491d8d64bba93b54faa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Creating volume 6ba31ba4-0a7b-42de-ba09-51c779dbd6cc {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:05 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:05 devstack sudo[111460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc 1073741824 Aug 26 16:26:05 devstack sudo[111460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:05 devstack sudo[111460]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc 1073741824" returned: 0 in 0.548s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:05 devstack sudo[111471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc Aug 26 16:26:05 devstack sudo[111471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-ecc46cf1-d200-47cc-a545-6051a3a35720 req-2d9b2db3-075e-4494-b99c-4bab1198aaf5 tempest-TestStampPattern-600342741 None] Terminate volume connection completed successfully. Aug 26 16:26:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-ecc46cf1-d200-47cc-a545-6051a3a35720 req-2d9b2db3-075e-4494-b99c-4bab1198aaf5 tempest-TestStampPattern-600342741 None] Deleting attachment da2bc8ee-94f1-4780-b169-3e74768ee788. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:26:06 devstack sudo[111471]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc" returned: 0 in 0.325s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9b6ce7-0074-4033-996f-e7448fec121c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe98fdbc-f753-4031-a297-c815b1ec4c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:06 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Volume volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc (6ba31ba4-0a7b-42de-ba09-51c779dbd6cc): created successfully Aug 26 16:26:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe98fdbc-f753-4031-a297-c815b1ec4c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Flow 'volume_create_manager' (e7940b53-2784-4f95-a319-80761018cace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-4f53edb6-112d-4668-a8bc-28426d6bce33 tempest-VolumesExtendTest-331690909 None] Created volume successfully. Aug 26 16:26:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] Creating offline snapshot b3a84454-96c7-4ca2-a6e8-978b09f5568f of volume 6ba31ba4-0a7b-42de-ba09-51c779dbd6cc {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:26:07 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce24ed68-4614-47f1-b59a-2b32f566dcec]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:07 devstack sudo[111481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc Aug 26 16:26:07 devstack sudo[111481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-42d2ea2c-b906-40ed-9ec6-cf2b28d62e48 req-9e64e988-9b32-4530-980a-e9381e7c387f tempest-TestServerVolumeAttachmentScenario-1887517869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:08 devstack sudo[111481]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc" returned: 0 in 0.699s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:08 devstack sudo[111503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f 1G Aug 26 16:26:08 devstack sudo[111503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:09 devstack sudo[111503]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f 1G" returned: 0 in 0.769s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:09 devstack sudo[111528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f Aug 26 16:26:09 devstack sudo[111528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:09 devstack sudo[111528]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f" returned: 0 in 0.379s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:09 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f is being set with open permissions: ugo+rw Aug 26 16:26:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:09 devstack sudo[111534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f Aug 26 16:26:09 devstack sudo[111534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:09 devstack sudo[111534]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f" returned: 0 in 0.303s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:09 devstack sudo[111538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.info Aug 26 16:26:09 devstack sudo[111538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:10 devstack sudo[111538]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.info" returned: 0 in 0.311s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:10 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.info is being set with open permissions: ugo+rw Aug 26 16:26:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:10 devstack sudo[111542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.info Aug 26 16:26:10 devstack sudo[111542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:10 devstack sudo[111542]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.info" returned: 0 in 0.306s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.925s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-42d2ea2c-b906-40ed-9ec6-cf2b28d62e48 req-9e64e988-9b32-4530-980a-e9381e7c387f tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.264s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [req-42d2ea2c-b906-40ed-9ec6-cf2b28d62e48 req-9e64e988-9b32-4530-980a-e9381e7c387f tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:10 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f64dbb83-0fc6-4efd-aff3-c7a2e1c46508 tempest-VolumesExtendTest-331690909 None] Create snapshot completed successfully Aug 26 16:26:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-42d2ea2c-b906-40ed-9ec6-cf2b28d62e48 req-9e64e988-9b32-4530-980a-e9381e7c387f tempest-TestServerVolumeAttachmentScenario-1887517869 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5', 'name': 'volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e86bf058-5867-4706-bbc0-a6f0d24a22b0', 'enforce_multipath': True} {{(pid=94407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 16:26:10 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-42d2ea2c-b906-40ed-9ec6-cf2b28d62e48 req-9e64e988-9b32-4530-980a-e9381e7c387f tempest-TestServerVolumeAttachmentScenario-1887517869 None] attachment_update completed successfully. Aug 26 16:26:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e0e2750e-b6cb-4bf8-ba67-66782f348482 tempest-VolumesExtendTest-331690909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e0e2750e-b6cb-4bf8-ba67-66782f348482 tempest-VolumesExtendTest-331690909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:10 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfebd8cf-5f3c-4930-ad29-49ce934868ec]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0e2750e-b6cb-4bf8-ba67-66782f348482 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:11 devstack sudo[111549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc Aug 26 16:26:11 devstack sudo[111549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Acquiring lock "cinder-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Lock "cinder-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Acquiring lock "cinder-quobyte-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Lock "cinder-quobyte-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:11 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af81502-1311-4895-9001-b334f57f37cd]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:11 devstack sudo[111549]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0e2750e-b6cb-4bf8-ba67-66782f348482 tempest-VolumesExtendTest-331690909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc" returned: 0 in 0.677s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:11 devstack sudo[111555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f Aug 26 16:26:11 devstack sudo[111555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0e2750e-b6cb-4bf8-ba67-66782f348482 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f 2G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e0e2750e-b6cb-4bf8-ba67-66782f348482 tempest-VolumesExtendTest-331690909 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f 2G" returned: 0 in 0.136s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e0e2750e-b6cb-4bf8-ba67-66782f348482 tempest-VolumesExtendTest-331690909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.872s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:11 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e0e2750e-b6cb-4bf8-ba67-66782f348482 tempest-VolumesExtendTest-331690909 None] Extend volume completed successfully. Aug 26 16:26:11 devstack sudo[111555]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f" returned: 0 in 0.413s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:11 devstack sudo[111567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f Aug 26 16:26:11 devstack sudo[111567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Acquiring lock "cinder-b3a84454-96c7-4ca2-a6e8-978b09f5568f-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:12 devstack sudo[111567]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f" returned: 0 in 0.330s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Lock "cinder-b3a84454-96c7-4ca2-a6e8-978b09f5568f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Acquiring lock "cinder-quobyte-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Lock "cinder-quobyte-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f" released by "delete_volume" :: held 0.813s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Lock "cinder-quobyte-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Acquiring lock "cinder-quobyte-b3a84454-96c7-4ca2-a6e8-978b09f5568f" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Lock "cinder-quobyte-b3a84454-96c7-4ca2-a6e8-978b09f5568f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Deleting offline snapshot b3a84454-96c7-4ca2-a6e8-978b09f5568f of volume 6ba31ba4-0a7b-42de-ba09-51c779dbd6cc {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] snapshot_file for this snap is: volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27c2c6f-ef47-40d2-9ddc-bf034be78e93]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Created reservations ['5a8d7183-3a1d-4693-8b03-4d531d8f5adb', '14b57dc0-7f65-451f-a2bf-ec0048bb7ccd', '2549b251-b155-4af6-a75e-8d42c2292d39', '65269664-e713-4e34-b78d-ec4c7d0fda09'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:12 devstack sudo[111571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:12 devstack sudo[111571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:12 devstack sudo[111570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f Aug 26 16:26:12 devstack sudo[111570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:12 devstack sudo[111571]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.444s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:12 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Deleted volume successfully. Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5ee3a8c7-27e1-4420-aec8-a6437995a83f tempest-TestStampPattern-600342741 None] Lock "cinder-08eb3d0f-3688-47df-92ea-c80e3f0c7a7f-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:12 devstack sudo[111570]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f" returned: 0 in 0.643s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d7eec9-4df4-4c52-9398-728a559ce60c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Acquiring lock "cinder-bb3656ba-ed6e-435d-aeb5-7f0e7453fc73-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Lock "cinder-bb3656ba-ed6e-435d-aeb5-7f0e7453fc73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Acquiring lock "cinder-quobyte-c0e7272f-24f5-4854-9a8a-600908c80f1f" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Lock "cinder-quobyte-c0e7272f-24f5-4854-9a8a-600908c80f1f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Acquiring lock "cinder-quobyte-bb3656ba-ed6e-435d-aeb5-7f0e7453fc73" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Lock "cinder-quobyte-bb3656ba-ed6e-435d-aeb5-7f0e7453fc73" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Deleting offline snapshot bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 of volume c0e7272f-24f5-4854-9a8a-600908c80f1f {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:26:13 devstack sudo[111578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc Aug 26 16:26:13 devstack sudo[111578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] snapshot_file for this snap is: volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fac8c5-3702-4786-93d8-7d60b7784d66]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:13 devstack sudo[111580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 Aug 26 16:26:13 devstack sudo[111580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:13 devstack sudo[111578]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc" returned: 0 in 0.419s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:13 devstack sudo[111590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f Aug 26 16:26:13 devstack sudo[111590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-c88849dd-29ff-43d1-ad0a-3fe11236c495 req-bd708e13-abd9-4075-8315-f603affe7865 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Terminate volume connection completed successfully. Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-c88849dd-29ff-43d1-ad0a-3fe11236c495 req-bd708e13-abd9-4075-8315-f603affe7865 tempest-TestServerVolumeAttachmentScenario-1887517869 None] Deleting attachment e86bf058-5867-4706-bbc0-a6f0d24a22b0. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:26:13 devstack sudo[111580]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73" returned: 0 in 0.385s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0e7272f-24f5-4854-9a8a-600908c80f1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[845f71eb-1b1e-4a4c-bc61-58f2f22f1379]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:13 devstack sudo[111595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f Aug 26 16:26:13 devstack sudo[111595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:13 devstack sudo[111590]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f" returned: 0 in 0.521s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:14 devstack sudo[111601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f Aug 26 16:26:14 devstack sudo[111601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:14 devstack sudo[111595]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f" returned: 0 in 0.666s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:14 devstack sudo[111607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 Aug 26 16:26:14 devstack sudo[111607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:14 devstack sudo[111601]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc.b3a84454-96c7-4ca2-a6e8-978b09f5568f" returned: 0 in 0.370s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Lock "cinder-quobyte-b3a84454-96c7-4ca2-a6e8-978b09f5568f" released by "_delete_snapshot" :: held 2.113s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Lock "cinder-quobyte-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc" released by "delete_snapshot" :: held 2.137s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:14 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Created reservations ['a0133169-4cb5-4689-beb9-c4f81890153f', '847361f7-6ec5-4f2a-94a6-04db77a2a324', '0f2ca513-7588-40eb-8e9c-91d3878b69d4', 'f1dbb506-07ae-47d7-b57b-8e3a8c57136f'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:14 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Delete snapshot completed successfully. Aug 26 16:26:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-584d8242-4490-4e2c-92fd-c3ff3d28bec8 tempest-VolumesExtendTest-331690909 None] Lock "cinder-b3a84454-96c7-4ca2-a6e8-978b09f5568f-delete_snapshot" released by "delete_snapshot" :: held 2.316s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:14 devstack sudo[111607]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73" returned: 0 in 0.476s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:14 devstack sudo[111613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73 Aug 26 16:26:14 devstack sudo[111613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:15 devstack sudo[111613]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f.bb3656ba-ed6e-435d-aeb5-7f0e7453fc73" returned: 0 in 0.319s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Lock "cinder-quobyte-bb3656ba-ed6e-435d-aeb5-7f0e7453fc73" released by "_delete_snapshot" :: held 1.982s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Lock "cinder-quobyte-c0e7272f-24f5-4854-9a8a-600908c80f1f" released by "delete_snapshot" :: held 2.010s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:15 devstack cinder-volume[94407]: INFO cinder.volume.manager [req-823da3c8-5a02-4a34-bf45-dd4d45b39a96 req-6f118cf0-e58c-480e-a6a6-81cd7a23aa8f tempest-TestServerVolumeAttachmentScenario-1887517869 None] Terminate volume connection completed successfully. Aug 26 16:26:15 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [req-823da3c8-5a02-4a34-bf45-dd4d45b39a96 req-6f118cf0-e58c-480e-a6a6-81cd7a23aa8f tempest-TestServerVolumeAttachmentScenario-1887517869 None] Deleting attachment 6ed53d61-802e-4dbe-8046-bf3b9215239e. {{(pid=94407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 16:26:15 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Created reservations ['b1417ae7-c0a8-4809-8c63-7d2eec6bce28', '7b800867-678d-404f-a1bf-d84ceb9c362e', '7b234a34-18cc-4f3e-9769-ddd2188ba4d0', 'edd3e0a4-02db-4cbe-9569-9d49ff160c9c'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:15 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Delete snapshot completed successfully. Aug 26 16:26:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a5c6ccd1-1ed4-427d-ba9b-553836c6997e tempest-TestStampPattern-600342741 None] Lock "cinder-bb3656ba-ed6e-435d-aeb5-7f0e7453fc73-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Acquiring lock "cinder-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Lock "cinder-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Acquiring lock "cinder-quobyte-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Lock "cinder-quobyte-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc" acquired by "delete_volume" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:15 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcdb52d-ed82-43d9-a217-71f0babae05f]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:15 devstack sudo[111647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc Aug 26 16:26:15 devstack sudo[111647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:15 devstack sudo[111647]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc" returned: 0 in 0.416s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:16 devstack sudo[111653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc Aug 26 16:26:16 devstack sudo[111653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:16 devstack sudo[111653]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc" returned: 0 in 0.354s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Lock "cinder-quobyte-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc" released by "delete_volume" :: held 0.849s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:16 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Created reservations ['cfb062a1-1e60-462d-8f95-18382950b107', '07aa3c7e-9252-4df2-875b-7f64912e30e8', 'a5d5e206-bdfe-4eea-ba3d-5e5e716812fd', '01a23b6f-8689-4b79-9283-74b40c2340f5'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:16 devstack sudo[111663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:16 devstack sudo[111663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:17 devstack sudo[111663]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.486s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:17 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:17 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Deleted volume successfully. Aug 26 16:26:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-72b934aa-41e2-4657-adbb-3f7ef2ec7b0a tempest-VolumesExtendTest-331690909 None] Lock "cinder-6ba31ba4-0a7b-42de-ba09-51c779dbd6cc-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:26:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:18 devstack sudo[111683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:18 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:18 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.431s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:26:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 28 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:26:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:26:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Acquiring lock "cinder-0ac6d376-79a5-4f22-8297-2cf4bf473c9f-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "cinder-0ac6d376-79a5-4f22-8297-2cf4bf473c9f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Acquiring lock "cinder-quobyte-0ac6d376-79a5-4f22-8297-2cf4bf473c9f" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "cinder-quobyte-0ac6d376-79a5-4f22-8297-2cf4bf473c9f" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:21 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff043bd-2abf-426e-91af-425f1423876c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:21 devstack sudo[111716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f Aug 26 16:26:21 devstack sudo[111716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (28e4a02c-77e6-41f8-810a-9216d1788b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8025da-207c-4b51-a449-2bc0e6a9a604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8025da-207c-4b51-a449-2bc0e6a9a604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1418629105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7159be-3026-44e2-8daa-be3a4cb74747,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='853408d4a31a444db278c117d52838a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:22Z,use_quota=True,user_id='365c8a9f6dd44464a099fd592d79fa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be30cdd-bd23-44cf-9482-384f9afaec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be30cdd-bd23-44cf-9482-384f9afaec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b985200-3e14-4907-b299-770d566dae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b985200-3e14-4907-b299-770d566dae2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c7159be-3026-44e2-8daa-be3a4cb74747', 'volume_name': 'volume-9c7159be-3026-44e2-8daa-be3a4cb74747', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ac0d6a-758d-4543-bf4a-e7e47e9a4d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ac0d6a-758d-4543-bf4a-e7e47e9a4d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71951c7e-5114-49b2-96cc-6a41f81578b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:22 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Volume 9c7159be-3026-44e2-8daa-be3a4cb74747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c7159be-3026-44e2-8daa-be3a4cb74747', 'volume_size': 1} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1418629105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7159be-3026-44e2-8daa-be3a4cb74747,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='853408d4a31a444db278c117d52838a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:22Z,use_quota=True,user_id='365c8a9f6dd44464a099fd592d79fa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Creating volume 9c7159be-3026-44e2-8daa-be3a4cb74747 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:22 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c7159be-3026-44e2-8daa-be3a4cb74747 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:22 devstack sudo[111716]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f" returned: 0 in 0.485s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:22 devstack sudo[111721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c7159be-3026-44e2-8daa-be3a4cb74747 1073741824 Aug 26 16:26:22 devstack sudo[111721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:22 devstack sudo[111722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f Aug 26 16:26:22 devstack sudo[111722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Acquiring lock "cinder-c0e7272f-24f5-4854-9a8a-600908c80f1f-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Lock "cinder-c0e7272f-24f5-4854-9a8a-600908c80f1f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Acquiring lock "cinder-quobyte-c0e7272f-24f5-4854-9a8a-600908c80f1f" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Lock "cinder-quobyte-c0e7272f-24f5-4854-9a8a-600908c80f1f" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cb300e-4283-4534-ad97-9bfae0ed2d53]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:22 devstack sudo[111722]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0ac6d376-79a5-4f22-8297-2cf4bf473c9f" returned: 0 in 0.372s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "cinder-quobyte-0ac6d376-79a5-4f22-8297-2cf4bf473c9f" released by "delete_volume" :: held 0.910s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:22 devstack sudo[111729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f Aug 26 16:26:22 devstack sudo[111729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Created reservations ['1bd87c57-b468-4dd8-9414-d8999c6054c7', 'e534e6fb-5f18-4c3e-9259-4fe0b71646f1', '5046bbca-f38f-4ea7-ac5e-a4a0f3a65557', 'de81b774-5700-4ffd-ac0d-21a38e1b9121'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:22 devstack sudo[111721]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c7159be-3026-44e2-8daa-be3a4cb74747 1073741824" returned: 0 in 0.574s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c7159be-3026-44e2-8daa-be3a4cb74747 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:22 devstack sudo[111732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:22 devstack sudo[111732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:22 devstack sudo[111733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c7159be-3026-44e2-8daa-be3a4cb74747 Aug 26 16:26:22 devstack sudo[111733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:22 devstack sudo[111729]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f" returned: 0 in 0.460s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:22 devstack sudo[111739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f Aug 26 16:26:22 devstack sudo[111739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:23 devstack sudo[111733]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c7159be-3026-44e2-8daa-be3a4cb74747" returned: 0 in 0.298s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:23 devstack sudo[111732]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71951c7e-5114-49b2-96cc-6a41f81578b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c7159be-3026-44e2-8daa-be3a4cb74747', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d66ddb4-7f60-4630-a154-f99b3f2c8fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.343s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:23 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Deleted volume successfully. Aug 26 16:26:23 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Volume volume-9c7159be-3026-44e2-8daa-be3a4cb74747 (9c7159be-3026-44e2-8daa-be3a4cb74747): created successfully Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d66ddb4-7f60-4630-a154-f99b3f2c8fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (28e4a02c-77e6-41f8-810a-9216d1788b88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:23 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6c17f075-386e-4f0d-ac49-06183ee5980a tempest-VolumesGetTest-454064183 None] Created volume successfully. Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-62d75ee6-d853-4689-9fee-34404de5e8bf tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "cinder-0ac6d376-79a5-4f22-8297-2cf4bf473c9f-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:23 devstack sudo[111739]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0e7272f-24f5-4854-9a8a-600908c80f1f" returned: 0 in 0.277s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Lock "cinder-quobyte-c0e7272f-24f5-4854-9a8a-600908c80f1f" released by "delete_volume" :: held 0.800s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Created reservations ['8372139e-0f4f-4904-81a7-7ba92f6ad91c', '610f7b74-a635-4844-a4e4-e83adb222e12', '081e3920-8477-4bcd-8d83-143622a717f7', 'e9765c38-48e2-49f0-998a-cac61a8da036'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:23 devstack sudo[111744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:23 devstack sudo[111744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:23 devstack sudo[111744]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.258s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:23 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Deleted volume successfully. Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-af90fd8a-71f7-4794-a5fd-0e46eac067b3 tempest-TestStampPattern-600342741 None] Lock "cinder-c0e7272f-24f5-4854-9a8a-600908c80f1f-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Acquiring lock "cinder-5bb30e02-a91b-4473-943d-6e427801bb06-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "cinder-5bb30e02-a91b-4473-943d-6e427801bb06-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Acquiring lock "cinder-quobyte-5bb30e02-a91b-4473-943d-6e427801bb06" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "cinder-quobyte-5bb30e02-a91b-4473-943d-6e427801bb06" acquired by "delete_volume" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:24 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97230df-457e-4d70-a7cc-b871bd6c2737]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5bb30e02-a91b-4473-943d-6e427801bb06 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:24 devstack sudo[111747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5bb30e02-a91b-4473-943d-6e427801bb06 Aug 26 16:26:24 devstack sudo[111747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:24 devstack sudo[111747]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5bb30e02-a91b-4473-943d-6e427801bb06" returned: 0 in 0.460s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5bb30e02-a91b-4473-943d-6e427801bb06 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:24 devstack sudo[111753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5bb30e02-a91b-4473-943d-6e427801bb06 Aug 26 16:26:24 devstack sudo[111753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:24 devstack sudo[111753]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5bb30e02-a91b-4473-943d-6e427801bb06" returned: 0 in 0.340s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "cinder-quobyte-5bb30e02-a91b-4473-943d-6e427801bb06" released by "delete_volume" :: held 0.849s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:24 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Created reservations ['412db97b-aded-4405-a47d-1130669a45e7', '0515cfeb-996e-4c00-bd40-f7b5a445352f', '1c3e7adc-74a1-4147-97bd-ff71f94b71ef', 'c27e36cb-e18a-4c6d-bed2-c850a9a38d05'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:25 devstack sudo[111756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:25 devstack sudo[111756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Flow 'volume_create_manager' (fef155d7-3316-4d24-8037-f28709333984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b4af30-cb90-443a-b668-bb38712f10fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b4af30-cb90-443a-b668-bb38712f10fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9302b12a-e2a0-4ca1-8b4e-904b4a282986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f275e2287fa24bfdb39f54b48283edeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:25Z,use_quota=True,user_id='c98ace1efd764475aec1c60f8227024f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cae3d63-89c9-477c-af83-5875da743e5c),volume_type_id=9cae3d63-89c9-477c-af83-5875da743e5c)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4986df8c-f02e-4ce8-8502-8c96c186a9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4986df8c-f02e-4ce8-8502-8c96c186a9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e675d92-a222-4794-a181-2e09ba9128c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.image.glance [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Creating Keystone auth plugin from conf {{(pid=94407) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (32066c90-4318-46f6-a83b-d6b4d2e06a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf9788c-dee4-4ebf-b825-5d2df522ff01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf9788c-dee4-4ebf-b825-5d2df522ff01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-521289954',display_name='tempest-VolumesGetTest-Volume-864944403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853408d4a31a444db278c117d52838a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:25Z,use_quota=True,user_id='365c8a9f6dd44464a099fd592d79fa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7882e905-ee7b-4faa-a985-c442b5c79ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7882e905-ee7b-4faa-a985-c442b5c79ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca7a964-8d82-4b06-843f-04fc78425e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca7a964-8d82-4b06-843f-04fc78425e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7', 'volume_name': 'volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95db8d87-6b99-400f-9e31-2974c0adcb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95db8d87-6b99-400f-9e31-2974c0adcb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddde418-469d-4de7-b736-ccd4ee7d1642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:25 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Volume 49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7', 'volume_size': 1} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-521289954',display_name='tempest-VolumesGetTest-Volume-864944403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853408d4a31a444db278c117d52838a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:25Z,use_quota=True,user_id='365c8a9f6dd44464a099fd592d79fa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Creating volume 49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:25 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:25 devstack sudo[111759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7 1073741824 Aug 26 16:26:25 devstack sudo[111759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:25 devstack sudo[111756]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.348s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:25 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Deleted volume successfully. Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fe54483f-f44f-40a4-859d-c7e05a48be0e tempest-TestServerVolumeAttachmentScenario-1887517869 None] Lock "cinder-5bb30e02-a91b-4473-943d-6e427801bb06-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e675d92-a222-4794-a181-2e09ba9128c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9302b12a-e2a0-4ca1-8b4e-904b4a282986', 'volume_name': 'volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986', 'volume_size': 1, 'image_id': '63ec12b7-7170-4dc7-9b14-60a2118f0128', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63ec12b7-7170-4dc7-9b14-60a2118f0128', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f65083730aaca18c7d48b32cc13ab27e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f275e2287fa24bfdb39f54b48283edeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '36bc5e754954ed899d847a77a85e0ef98e3d10f25f32a4d3625f01eadb09f3225ba85ea7de9af9fed04b64d248deea02c4991d497eb7c6b8ee91376402da43b0', 'id': '63ec12b7-7170-4dc7-9b14-60a2118f0128', 'created_at': datetime.datetime(2026, 8, 26, 14, 26, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 26, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63ec12b7-7170-4dc7-9b14-60a2118f0128/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568d3d28-99a1-4cfe-b3f2-62d33f34e658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568d3d28-99a1-4cfe-b3f2-62d33f34e658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5917b3-881f-4c26-a9d4-d05f3e1f2243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:25 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Volume 9302b12a-e2a0-4ca1-8b4e-904b4a282986: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986', 'volume_size': 1, 'image_id': '63ec12b7-7170-4dc7-9b14-60a2118f0128', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63ec12b7-7170-4dc7-9b14-60a2118f0128', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f65083730aaca18c7d48b32cc13ab27e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f275e2287fa24bfdb39f54b48283edeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '36bc5e754954ed899d847a77a85e0ef98e3d10f25f32a4d3625f01eadb09f3225ba85ea7de9af9fed04b64d248deea02c4991d497eb7c6b8ee91376402da43b0', 'id': '63ec12b7-7170-4dc7-9b14-60a2118f0128', 'created_at': datetime.datetime(2026, 8, 26, 14, 26, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 26, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63ec12b7-7170-4dc7-9b14-60a2118f0128/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Trying to clone 9302b12a-e2a0-4ca1-8b4e-904b4a282986 from image 63ec12b7-7170-4dc7-9b14-60a2118f0128 at location (None, [{'url': 'file:///opt/stack/data/glance/images/63ec12b7-7170-4dc7-9b14-60a2118f0128', 'metadata': {}}]). {{(pid=94407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 16:26:25 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Image download 0.00 MB at 0.00 MB/s Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be7889c-5ea5-412b-84c3-0c27d1465260]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:25 devstack sudo[111759]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7 1073741824" returned: 0 in 0.612s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:25 devstack sudo[111765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD Aug 26 16:26:26 devstack sudo[111765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:26 devstack sudo[111767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7 Aug 26 16:26:26 devstack sudo[111767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:26 devstack sudo[111765]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:26 devstack sudo[111767]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7" returned: 0 in 0.310s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddde418-469d-4de7-b736-ccd4ee7d1642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d184126a-26dc-4c47-ac2c-5548db0537ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:26 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Volume volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7 (49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7): created successfully Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d184126a-26dc-4c47-ac2c-5548db0537ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (32066c90-4318-46f6-a83b-d6b4d2e06a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:26 devstack sudo[111771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD Aug 26 16:26:26 devstack sudo[111771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:26 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f6b0f055-cffc-4504-b4c2-4c45d0c359cb tempest-VolumesGetTest-454064183 None] Created volume successfully. Aug 26 16:26:26 devstack sudo[111771]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Temporary image 63ec12b7-7170-4dc7-9b14-60a2118f0128 is fetched for user c98ace1efd764475aec1c60f8227024f. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcc2b50-8518-46e3-8be0-62353737bf5c]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:26 devstack sudo[111778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD Aug 26 16:26:26 devstack sudo[111778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:27 devstack sudo[111778]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Lock "cinder-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:27 devstack sudo[111783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD Aug 26 16:26:27 devstack sudo[111783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-quobyte-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2124d813-8b67-4e7b-9e40-51304598442e]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:27 devstack sudo[111783]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD" returned: 1 in 0.429s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9302b12a-e2a0-4ca1-8b4e-904b4a282986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f275e2287fa24bfdb39f54b48283edeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:25Z,use_quota=True,user_id='c98ace1efd764475aec1c60f8227024f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cae3d63-89c9-477c-af83-5875da743e5c),volume_type_id=9cae3d63-89c9-477c-af83-5875da743e5c)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Creating volume 9302b12a-e2a0-4ca1-8b4e-904b4a282986 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:27 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:27 devstack sudo[111785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7 Aug 26 16:26:27 devstack sudo[111785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:27 devstack sudo[111799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 1073741824 Aug 26 16:26:27 devstack sudo[111799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:28 devstack sudo[111785]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7" returned: 0 in 0.688s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:28 devstack sudo[111832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7 Aug 26 16:26:28 devstack sudo[111832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:28 devstack sudo[111799]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 1073741824" returned: 0 in 0.669s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:28 devstack sudo[111837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 Aug 26 16:26:28 devstack sudo[111837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:28 devstack sudo[111832]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7" returned: 0 in 0.355s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7" released by "delete_volume" :: held 1.099s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Created reservations ['7be46d76-70e5-4eb8-806d-f488d0ddd073', '58cacf27-ca40-47cb-b275-b12ad5cb76c3', 'a0381239-d678-4e64-b410-a0acff8b9ac4', '0387451f-0158-4fef-9b7e-11752172713b'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:28 devstack sudo[111837]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986" returned: 0 in 0.295s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:28 devstack sudo[111841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:28 devstack sudo[111841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Attempting download of 63ec12b7-7170-4dc7-9b14-60a2118f0128 ((None, [{'url': 'file:///opt/stack/data/glance/images/63ec12b7-7170-4dc7-9b14-60a2118f0128', 'metadata': {}}])) to volume 9302b12a-e2a0-4ca1-8b4e-904b4a282986. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6efb20-ea8e-4019-88cb-2d6ac9232d23]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63ec12b7-7170-4dc7-9b14-60a2118f0128_aczijhm6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:28 devstack sudo[111843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63ec12b7-7170-4dc7-9b14-60a2118f0128_aczijhm6 Aug 26 16:26:28 devstack sudo[111843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:28 devstack sudo[111841]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.298s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:28 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:28 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Deleted volume successfully. Aug 26 16:26:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-070b81d0-068b-422f-aa14-66743be2454f tempest-VolumesGetTest-454064183 None] Lock "cinder-49b5ac48-cd9d-4ffa-9e81-8fb6aa9d5ac7-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:29 devstack sudo[111843]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63ec12b7-7170-4dc7-9b14-60a2118f0128_aczijhm6" returned: 0 in 0.421s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63ec12b7-7170-4dc7-9b14-60a2118f0128_aczijhm6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:29 devstack sudo[111848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63ec12b7-7170-4dc7-9b14-60a2118f0128_aczijhm6 Aug 26 16:26:29 devstack sudo[111848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:29 devstack sudo[111848]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63ec12b7-7170-4dc7-9b14-60a2118f0128_aczijhm6" returned: 1 in 0.459s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63ec12b7-7170-4dc7-9b14-60a2118f0128_aczijhm6' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:26:29 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfed79f-0e06-4ebf-97dd-6ec0bb36c39f]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-9c7159be-3026-44e2-8daa-be3a4cb74747-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Lock "cinder-9c7159be-3026-44e2-8daa-be3a4cb74747-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-quobyte-9c7159be-3026-44e2-8daa-be3a4cb74747" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:29 devstack sudo[111852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD Aug 26 16:26:29 devstack sudo[111852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-9c7159be-3026-44e2-8daa-be3a4cb74747" acquired by "delete_volume" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:29 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[73881618-d300-4f27-82e2-dbf849a81fc3]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c7159be-3026-44e2-8daa-be3a4cb74747 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:29 devstack sudo[111854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c7159be-3026-44e2-8daa-be3a4cb74747 Aug 26 16:26:29 devstack sudo[111854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:30 devstack sudo[111852]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:30 devstack sudo[111854]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c7159be-3026-44e2-8daa-be3a4cb74747" returned: 0 in 0.467s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c7159be-3026-44e2-8daa-be3a4cb74747 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:30 devstack sudo[111859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD Aug 26 16:26:30 devstack sudo[111859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:30 devstack sudo[111864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c7159be-3026-44e2-8daa-be3a4cb74747 Aug 26 16:26:30 devstack sudo[111864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:30 devstack sudo[111859]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] 63ec12b7-7170-4dc7-9b14-60a2118f0128 was raw, converting to qcow2 {{(pid=94407) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:30 devstack sudo[111864]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9c7159be-3026-44e2-8daa-be3a4cb74747" returned: 0 in 0.347s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:30 devstack sudo[111872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 Aug 26 16:26:30 devstack sudo[111872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-9c7159be-3026-44e2-8daa-be3a4cb74747" released by "delete_volume" :: held 0.874s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Created reservations ['7311a42a-b316-4d60-8314-820e2c758d22', '37573069-7a35-4936-a17f-adf8611d0641', 'b34e7ec8-66b4-4b08-8d05-1d5052ca5ed4', 'e6712d8d-c71e-44f2-8028-e466693cee86'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:30 devstack sudo[111874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:30 devstack sudo[111874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:31 devstack sudo[111874]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.454s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:31 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Deleted volume successfully. Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-74cd5e99-8154-4974-b1d1-38904fe349ed tempest-VolumesGetTest-454064183 None] Lock "cinder-9c7159be-3026-44e2-8daa-be3a4cb74747-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:31 devstack sudo[111872]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986" returned: 0 in 0.856s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_63ec12b7-7170-4dc7-9b14-60a2118f0128_xjp67upwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:26:31 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:31 devstack sudo[111880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 1G Aug 26 16:26:31 devstack sudo[111880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (a21c08ea-2856-4db3-a011-5eb639ef2a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d850e08-7e49-46db-92fa-0a9dfd8b49a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d850e08-7e49-46db-92fa-0a9dfd8b49a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-81391855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e08b508-af04-4327-aca9-0131266e0315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853408d4a31a444db278c117d52838a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:32Z,use_quota=True,user_id='365c8a9f6dd44464a099fd592d79fa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c31000-d869-4d38-a102-7e635f1987fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c31000-d869-4d38-a102-7e635f1987fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2e5a96-3f8e-412d-9f2f-4e508e4e754c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2e5a96-3f8e-412d-9f2f-4e508e4e754c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e08b508-af04-4327-aca9-0131266e0315', 'volume_name': 'volume-3e08b508-af04-4327-aca9-0131266e0315', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404de992-abd2-49be-b772-d1ae792819e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404de992-abd2-49be-b772-d1ae792819e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca14cef0-4fe6-417f-9438-75b5901e7f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:31 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Volume 3e08b508-af04-4327-aca9-0131266e0315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e08b508-af04-4327-aca9-0131266e0315', 'volume_size': 1} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-81391855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e08b508-af04-4327-aca9-0131266e0315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853408d4a31a444db278c117d52838a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:32Z,use_quota=True,user_id='365c8a9f6dd44464a099fd592d79fa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Creating volume 3e08b508-af04-4327-aca9-0131266e0315 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:31 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:31 devstack sudo[111883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 1073741824 Aug 26 16:26:31 devstack sudo[111883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:31 devstack sudo[111880]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 1G" returned: 0 in 0.478s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Downloaded image 63ec12b7-7170-4dc7-9b14-60a2118f0128 ((None, [{'url': 'file:///opt/stack/data/glance/images/63ec12b7-7170-4dc7-9b14-60a2118f0128', 'metadata': {}}])) to volume 9302b12a-e2a0-4ca1-8b4e-904b4a282986 successfully. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Temporary image 63ec12b7-7170-4dc7-9b14-60a2118f0128 for user c98ace1efd764475aec1c60f8227024f is deleted. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 16:26:31 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Marking volume 9302b12a-e2a0-4ca1-8b4e-904b4a282986 as bootable. {{(pid=94407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Copying metadata from image 63ec12b7-7170-4dc7-9b14-60a2118f0128 to 9302b12a-e2a0-4ca1-8b4e-904b4a282986. {{(pid=94407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Creating volume glance metadata for volume 9302b12a-e2a0-4ca1-8b4e-904b4a282986 backed by image 63ec12b7-7170-4dc7-9b14-60a2118f0128 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '63ec12b7-7170-4dc7-9b14-60a2118f0128', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f65083730aaca18c7d48b32cc13ab27e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5917b3-881f-4c26-a9d4-d05f3e1f2243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986', 'volume_size': 1, 'image_id': '63ec12b7-7170-4dc7-9b14-60a2118f0128', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63ec12b7-7170-4dc7-9b14-60a2118f0128', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f65083730aaca18c7d48b32cc13ab27e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f275e2287fa24bfdb39f54b48283edeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '36bc5e754954ed899d847a77a85e0ef98e3d10f25f32a4d3625f01eadb09f3225ba85ea7de9af9fed04b64d248deea02c4991d497eb7c6b8ee91376402da43b0', 'id': '63ec12b7-7170-4dc7-9b14-60a2118f0128', 'created_at': datetime.datetime(2026, 8, 26, 14, 26, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 26, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63ec12b7-7170-4dc7-9b14-60a2118f0128/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d7933b-0861-4a7d-8e84-49e7e9ed3671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:32 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Volume volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 (9302b12a-e2a0-4ca1-8b4e-904b4a282986): created successfully Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d7933b-0861-4a7d-8e84-49e7e9ed3671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Flow 'volume_create_manager' (fef155d7-3316-4d24-8037-f28709333984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:32 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8358478b-6b12-4306-a02b-b57c2195a07f tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Created volume successfully. Aug 26 16:26:32 devstack sudo[111883]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 1073741824" returned: 0 in 0.597s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:32 devstack sudo[111893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 Aug 26 16:26:32 devstack sudo[111893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Acquiring lock "cinder-9302b12a-e2a0-4ca1-8b4e-904b4a282986-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Lock "cinder-9302b12a-e2a0-4ca1-8b4e-904b4a282986-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Acquiring lock "cinder-quobyte-9302b12a-e2a0-4ca1-8b4e-904b4a282986" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Lock "cinder-quobyte-9302b12a-e2a0-4ca1-8b4e-904b4a282986" acquired by "delete_volume" :: waited 0.032s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:32 devstack sudo[111893]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fb0206-968d-4d98-88dd-875ae12fc683]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315" returned: 0 in 0.419s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca14cef0-4fe6-417f-9438-75b5901e7f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e08b508-af04-4327-aca9-0131266e0315', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be25e20-6b87-4aaa-b03d-ba448cff6269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:32 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Volume volume-3e08b508-af04-4327-aca9-0131266e0315 (3e08b508-af04-4327-aca9-0131266e0315): created successfully Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be25e20-6b87-4aaa-b03d-ba448cff6269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:32 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (a21c08ea-2856-4db3-a011-5eb639ef2a11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:32 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-fee04de3-e87b-402e-85e6-1977292e5294 tempest-VolumesGetTest-454064183 None] Created volume successfully. Aug 26 16:26:32 devstack sudo[111897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 Aug 26 16:26:32 devstack sudo[111897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:33 devstack sudo[111897]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986" returned: 0 in 0.471s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:33 devstack sudo[111902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986 Aug 26 16:26:33 devstack sudo[111902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:33 devstack sudo[111902]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9302b12a-e2a0-4ca1-8b4e-904b4a282986" returned: 0 in 0.258s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:33 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Lock "cinder-quobyte-9302b12a-e2a0-4ca1-8b4e-904b4a282986" released by "delete_volume" :: held 0.802s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:33 devstack cinder-volume[94407]: WARNING cinder.quota [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:26:33 devstack cinder-volume[94407]: WARNING cinder.quota [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 16:26:33 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Created reservations ['d913d763-7151-47ab-b31a-d1a559023719', '74b2965b-ca9b-4efc-bb1d-10c10a6870bd', '69570f2d-d4a4-40c2-ba92-38ec5192ae26', '8688ef68-f10d-4290-b879-5b03f2424a36'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:33 devstack sudo[111905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:33 devstack sudo[111905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:34 devstack sudo[111905]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.515s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:34 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Deleted volume successfully. Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ebd99d3a-1c9d-49f5-ba47-21cccdae5bf3 tempest-VolumeAndVolumeTypeFromImageTest-249467473 None] Lock "cinder-9302b12a-e2a0-4ca1-8b4e-904b4a282986-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (559e60a0-758b-4b1a-9035-0e211f586b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8851d63f-3447-43d6-bbc5-b2c45c951df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8851d63f-3447-43d6-bbc5-b2c45c951df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-317816224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcaff03e-89fa-4bfa-a11a-2a402b549206,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='853408d4a31a444db278c117d52838a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3e08b508-af04-4327-aca9-0131266e0315,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:34Z,use_quota=True,user_id='365c8a9f6dd44464a099fd592d79fa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1b4b43-1888-4566-af87-365c3488cc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1b4b43-1888-4566-af87-365c3488cc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2dc87f6-29d6-4a32-a981-bd41250d48a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2dc87f6-29d6-4a32-a981-bd41250d48a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bcaff03e-89fa-4bfa-a11a-2a402b549206', 'volume_name': 'volume-bcaff03e-89fa-4bfa-a11a-2a402b549206', 'volume_size': 1, 'source_volid': '3e08b508-af04-4327-aca9-0131266e0315', 'source_volstatus': 'available'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11aa8cba-4d9b-415b-b84b-729c22b400da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11aa8cba-4d9b-415b-b84b-729c22b400da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde57a42-fd86-438d-b519-7b0c1225b13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:34 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Volume bcaff03e-89fa-4bfa-a11a-2a402b549206: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bcaff03e-89fa-4bfa-a11a-2a402b549206', 'volume_size': 1, 'source_volid': '3e08b508-af04-4327-aca9-0131266e0315', 'source_volstatus': 'available'} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:34 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Cloning volume 3e08b508-af04-4327-aca9-0131266e0315 to volume bcaff03e-89fa-4bfa-a11a-2a402b549206 Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Creating offline snapshot 195543da-8636-47af-887a-d4a87015ac89 of volume 3e08b508-af04-4327-aca9-0131266e0315 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40ab87b-d064-4677-9549-8eb036a05d28]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:34 devstack sudo[111909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 Aug 26 16:26:34 devstack sudo[111909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:35 devstack sudo[111909]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315" returned: 0 in 0.589s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:35 devstack sudo[111914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 1G Aug 26 16:26:35 devstack sudo[111914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:35 devstack sudo[111914]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 1G" returned: 0 in 0.524s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e08b508-af04-4327-aca9-0131266e0315 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:35 devstack sudo[111921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e08b508-af04-4327-aca9-0131266e0315 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 Aug 26 16:26:35 devstack sudo[111921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:36 devstack sudo[111921]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e08b508-af04-4327-aca9-0131266e0315 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89" returned: 0 in 0.392s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:36 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 is being set with open permissions: ugo+rw Aug 26 16:26:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:36 devstack sudo[111935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 Aug 26 16:26:36 devstack sudo[111935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:36 devstack sudo[111935]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89" returned: 0 in 0.301s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:36 devstack sudo[111938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.info Aug 26 16:26:36 devstack sudo[111938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:36 devstack sudo[111938]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.info" returned: 0 in 0.359s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:36 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.info is being set with open permissions: ugo+rw Aug 26 16:26:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:36 devstack sudo[111942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.info Aug 26 16:26:36 devstack sudo[111942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:37 devstack sudo[111942]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.info" returned: 0 in 0.315s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-quobyte-bcaff03e-89fa-4bfa-a11a-2a402b549206" by "_copy_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-bcaff03e-89fa-4bfa-a11a-2a402b549206" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] snapshot: 195543da-8636-47af-887a-d4a87015ac89, volume: bcaff03e-89fa-4bfa-a11a-2a402b549206, {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d73444f-8b37-4925-8026-754271b979be]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:37 devstack sudo[111945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 Aug 26 16:26:37 devstack sudo[111945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:37 devstack sudo[111945]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89" returned: 0 in 0.446s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e08b508-af04-4327-aca9-0131266e0315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[067db0ce-d128-404d-b744-3ca05588bbe3]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:37 devstack sudo[111950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 Aug 26 16:26:37 devstack sudo[111950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:38 devstack sudo[111950]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315" returned: 0 in 0.485s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:38 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] will copy from snapshot at /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 16:26:38 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Creating direct copy from snapshot {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 16:26:38 devstack cinder-volume[94407]: DEBUG cinder.utils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Path /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206 not found in is_blk_device check {{(pid=94407) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 16:26:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:38 devstack sudo[111955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206 Aug 26 16:26:38 devstack sudo[111955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:41 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Flow 'volume_create_manager' (a9a44259-2afb-4721-9a51-ea51565dbb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f0d920-e54e-4a21-8f89-454cae3e9c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f0d920-e54e-4a21-8f89-454cae3e9c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-355397806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d262b8-e13d-40f5-bb3d-9428ee63e78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12764ec6b3fe41d2a3d0baf50b07e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:41Z,use_quota=True,user_id='1f7bebbe6f7c48bda880d92eccba9e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7244773-c72a-4b85-88f8-0f14fc5227a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7244773-c72a-4b85-88f8-0f14fc5227a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107a6f07-eb14-458f-b1d2-2a5d75020c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107a6f07-eb14-458f-b1d2-2a5d75020c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62d262b8-e13d-40f5-bb3d-9428ee63e78f', 'volume_name': 'volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ecd8f4-9d88-483c-a38a-dd2a373e8fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ecd8f4-9d88-483c-a38a-dd2a373e8fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7725ba-049b-4955-9a45-c4baf1c3a052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:41 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Volume 62d262b8-e13d-40f5-bb3d-9428ee63e78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f', 'volume_size': 1} Aug 26 16:26:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:42 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Flow 'volume_create_manager' (18577e3b-5b15-42fd-9c30-394da1f5ed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b6d900-494d-47b7-a180-6796a662f8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b6d900-494d-47b7-a180-6796a662f8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-483507359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df837612-9227-4837-b69f-a59fb62ad90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12764ec6b3fe41d2a3d0baf50b07e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:42Z,use_quota=True,user_id='1f7bebbe6f7c48bda880d92eccba9e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5854f88c-5095-4a5d-9792-15f15a499fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5854f88c-5095-4a5d-9792-15f15a499fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faebed49-b252-4a24-a1b0-85c778399a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faebed49-b252-4a24-a1b0-85c778399a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df837612-9227-4837-b69f-a59fb62ad90b', 'volume_name': 'volume-df837612-9227-4837-b69f-a59fb62ad90b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac225228-81f7-4c5f-91b4-2f49b5399e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac225228-81f7-4c5f-91b4-2f49b5399e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d48002-50ca-437e-9bb1-627c079398b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:42 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Volume df837612-9227-4837-b69f-a59fb62ad90b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df837612-9227-4837-b69f-a59fb62ad90b', 'volume_size': 1} Aug 26 16:26:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:44 devstack sudo[111955]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206" returned: 0 in 6.353s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:44 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206 {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:26:44 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Converted 1024.00 MB image at 161.16 MB/s Aug 26 16:26:44 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206 is being set with open permissions: ugo+rw Aug 26 16:26:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:44 devstack sudo[111979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206 Aug 26 16:26:44 devstack sudo[111979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:44 devstack sudo[111979]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206" returned: 0 in 0.255s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-bcaff03e-89fa-4bfa-a11a-2a402b549206" released by "_copy_volume_from_snapshot" :: held 7.637s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-quobyte-195543da-8636-47af-887a-d4a87015ac89" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-195543da-8636-47af-887a-d4a87015ac89" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Deleting offline snapshot 195543da-8636-47af-887a-d4a87015ac89 of volume 3e08b508-af04-4327-aca9-0131266e0315 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:26:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] snapshot_file for this snap is: volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:26:44 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7aa7dd-6f29-41ee-b5da-1e45aca0081d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Flow 'volume_create_manager' (79c8d395-4c49-4340-9c30-c4bb6d8b8d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bb3d9c-0020-438f-ab86-59ad5b7d9016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bb3d9c-0020-438f-ab86-59ad5b7d9016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751928013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b00f47e-1e3e-41ab-9be9-f83754694bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72d02fe4b474765a580a1abc6625762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:45Z,use_quota=True,user_id='8cb2351d7c3a42a8a0994f82dccf755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3be1c9-b23b-4ba4-9a51-939d9921c724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3be1c9-b23b-4ba4-9a51-939d9921c724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0963ebe2-6543-46ac-9aa1-f5abd1e1d932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0963ebe2-6543-46ac-9aa1-f5abd1e1d932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b00f47e-1e3e-41ab-9be9-f83754694bcb', 'volume_name': 'volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf0278b-e77c-45f2-a9c2-a0fece38a87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf0278b-e77c-45f2-a9c2-a0fece38a87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280802be-751b-4290-9c00-a2c14bd0a433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume 1b00f47e-1e3e-41ab-9be9-f83754694bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb', 'volume_size': 1} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:45 devstack sudo[111982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 Aug 26 16:26:45 devstack sudo[111982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:45 devstack sudo[111982]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89" returned: 0 in 0.403s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e08b508-af04-4327-aca9-0131266e0315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb9c331-99c2-4193-84cb-8a32712b0e86]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Flow 'volume_create_manager' (4e5c1b87-a322-44d7-92f6-58931cdbc178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8d8984-4081-4e40-9b85-68a894037fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Flow 'volume_create_manager' (ba3c6c3a-a02f-49f2-b5c5-a07b808e9c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df7cae9-dcb6-4735-bf13-98107b9bbe1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8d8984-4081-4e40-9b85-68a894037fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1021744132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0582c2a5-147d-4ec7-87a1-2542e0615143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12764ec6b3fe41d2a3d0baf50b07e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:45Z,use_quota=True,user_id='1f7bebbe6f7c48bda880d92eccba9e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fa7f69-7eb5-42cb-bdcb-0cce534319b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fa7f69-7eb5-42cb-bdcb-0cce534319b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280018ec-3d7c-47e2-a669-35ab810ab9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280018ec-3d7c-47e2-a669-35ab810ab9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0582c2a5-147d-4ec7-87a1-2542e0615143', 'volume_name': 'volume-0582c2a5-147d-4ec7-87a1-2542e0615143', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c0047b-19e5-4e26-81e4-02ae7ba45124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c0047b-19e5-4e26-81e4-02ae7ba45124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a50519-2790-4665-889d-da7e2d89e467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Volume 0582c2a5-147d-4ec7-87a1-2542e0615143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0582c2a5-147d-4ec7-87a1-2542e0615143', 'volume_size': 1} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:45 devstack sudo[111989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 Aug 26 16:26:45 devstack sudo[111989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df7cae9-dcb6-4735-bf13-98107b9bbe1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1363582566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc48f158-2917-4f67-aa5e-d0d042cee562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12764ec6b3fe41d2a3d0baf50b07e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:45Z,use_quota=True,user_id='1f7bebbe6f7c48bda880d92eccba9e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b608bc-3c16-4e86-8f1c-11bcab5369ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b608bc-3c16-4e86-8f1c-11bcab5369ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd04391-c168-4106-a141-ef9ceb60e27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd04391-c168-4106-a141-ef9ceb60e27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc48f158-2917-4f67-aa5e-d0d042cee562', 'volume_name': 'volume-dc48f158-2917-4f67-aa5e-d0d042cee562', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fa85f2-e236-43a0-804e-e3b8862d3f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fa85f2-e236-43a0-804e-e3b8862d3f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc74257-2cd6-4a31-a302-33533d5ff180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Volume dc48f158-2917-4f67-aa5e-d0d042cee562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc48f158-2917-4f67-aa5e-d0d042cee562', 'volume_size': 1} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Flow 'volume_create_manager' (dd2d0aaa-8838-4beb-9a63-7feba8ae93f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8c54b1-4b4c-4a73-a8b4-4b43092949bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Flow 'volume_create_manager' (bb3e1b03-8afa-4782-879b-3d67d78e51a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93267425-eb03-4f2f-8c3b-39742846ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8c54b1-4b4c-4a73-a8b4-4b43092949bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eec1747-f6df-48d2-a314-4b99bbc0874c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75cf392d1a4d48219d2a801908e84360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:46Z,use_quota=True,user_id='21256fa1d71b460b91a62d7508b011b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb0bf6d-c44a-46fa-8524-f8aeb8d4e10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb0bf6d-c44a-46fa-8524-f8aeb8d4e10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b2b97c-f106-441e-bbb7-2593384d6618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b2b97c-f106-441e-bbb7-2593384d6618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eec1747-f6df-48d2-a314-4b99bbc0874c', 'volume_name': 'volume-9eec1747-f6df-48d2-a314-4b99bbc0874c', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9575273-757c-46e9-b842-cfd211cff921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9575273-757c-46e9-b842-cfd211cff921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76da8d3-8b3a-4e5e-bacf-e69cbd2cb470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Volume 9eec1747-f6df-48d2-a314-4b99bbc0874c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eec1747-f6df-48d2-a314-4b99bbc0874c', 'volume_size': 1} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93267425-eb03-4f2f-8c3b-39742846ac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1374535715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf6634c-9860-46a3-9cf7-234b42261437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12764ec6b3fe41d2a3d0baf50b07e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:46Z,use_quota=True,user_id='1f7bebbe6f7c48bda880d92eccba9e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92aa1300-ab0c-4359-bfaa-fcd0971c2260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92aa1300-ab0c-4359-bfaa-fcd0971c2260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b836cb-42b7-4d59-98da-f8a3beb2d2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b836cb-42b7-4d59-98da-f8a3beb2d2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf6634c-9860-46a3-9cf7-234b42261437', 'volume_name': 'volume-ebf6634c-9860-46a3-9cf7-234b42261437', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae7e104-1b60-48aa-87f2-b7fa82cce00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae7e104-1b60-48aa-87f2-b7fa82cce00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a952ca-09fe-4773-8c34-77b7516a2ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:45 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Volume ebf6634c-9860-46a3-9cf7-234b42261437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf6634c-9860-46a3-9cf7-234b42261437', 'volume_size': 1} Aug 26 16:26:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:46 devstack sudo[111989]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315" returned: 0 in 0.611s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:46 devstack sudo[111996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 Aug 26 16:26:46 devstack sudo[111996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:46 devstack sudo[111996]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89" returned: 0 in 0.329s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:46 devstack sudo[112002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89 Aug 26 16:26:46 devstack sudo[112002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:46 devstack sudo[112002]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315.195543da-8636-47af-887a-d4a87015ac89" returned: 0 in 0.248s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-195543da-8636-47af-887a-d4a87015ac89" released by "_delete_snapshot" :: held 1.692s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.030s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.377s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-355397806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d262b8-e13d-40f5-bb3d-9428ee63e78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12764ec6b3fe41d2a3d0baf50b07e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:41Z,use_quota=True,user_id='1f7bebbe6f7c48bda880d92eccba9e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Creating volume 62d262b8-e13d-40f5-bb3d-9428ee63e78f {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:46 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:46 devstack sudo[112005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f 1073741824 Aug 26 16:26:46 devstack sudo[112005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde57a42-fd86-438d-b519-7b0c1225b13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcaff03e-89fa-4bfa-a11a-2a402b549206', 'volume_size': 1, 'source_volid': '3e08b508-af04-4327-aca9-0131266e0315', 'source_volstatus': 'available'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e16a304-077f-4759-b2b0-6f32121551ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:46 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Volume volume-bcaff03e-89fa-4bfa-a11a-2a402b549206 (bcaff03e-89fa-4bfa-a11a-2a402b549206): created successfully Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e16a304-077f-4759-b2b0-6f32121551ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (559e60a0-758b-4b1a-9035-0e211f586b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:46 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-45bf2787-deab-4fe5-b249-721fcf3e29b3 tempest-VolumesGetTest-454064183 None] Created volume successfully. Aug 26 16:26:47 devstack sudo[112005]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f 1073741824" returned: 0 in 0.401s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:47 devstack sudo[112010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f Aug 26 16:26:47 devstack sudo[112010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:47 devstack sudo[112010]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f" returned: 0 in 0.249s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.197s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-483507359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df837612-9227-4837-b69f-a59fb62ad90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12764ec6b3fe41d2a3d0baf50b07e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:42Z,use_quota=True,user_id='1f7bebbe6f7c48bda880d92eccba9e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Creating volume df837612-9227-4837-b69f-a59fb62ad90b {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:47 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-df837612-9227-4837-b69f-a59fb62ad90b 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7725ba-049b-4955-9a45-c4baf1c3a052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:47 devstack sudo[112013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-df837612-9227-4837-b69f-a59fb62ad90b 1073741824 Aug 26 16:26:47 devstack sudo[112013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48960d83-0757-444b-bc87-c9c9e237df8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:47 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Volume volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f (62d262b8-e13d-40f5-bb3d-9428ee63e78f): created successfully Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48960d83-0757-444b-bc87-c9c9e237df8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Flow 'volume_create_manager' (a9a44259-2afb-4721-9a51-ea51565dbb17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:47 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b02f5ad0-13b1-4f43-a862-a62c8fd5fe60 tempest-CreateVolumesFromImageTest-550300385 None] Created volume successfully. Aug 26 16:26:47 devstack sudo[112013]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-df837612-9227-4837-b69f-a59fb62ad90b 1073741824" returned: 0 in 0.461s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-df837612-9227-4837-b69f-a59fb62ad90b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:47 devstack sudo[112019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-df837612-9227-4837-b69f-a59fb62ad90b Aug 26 16:26:47 devstack sudo[112019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:48 devstack sudo[112019]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-df837612-9227-4837-b69f-a59fb62ad90b" returned: 0 in 0.243s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.022s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751928013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b00f47e-1e3e-41ab-9be9-f83754694bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72d02fe4b474765a580a1abc6625762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:45Z,use_quota=True,user_id='8cb2351d7c3a42a8a0994f82dccf755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Creating volume 1b00f47e-1e3e-41ab-9be9-f83754694bcb {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:48 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d48002-50ca-437e-9bb1-627c079398b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df837612-9227-4837-b69f-a59fb62ad90b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67f38bf-eed2-4eec-8b01-7167e25fc4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:48 devstack sudo[112022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb 1073741824 Aug 26 16:26:48 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Volume volume-df837612-9227-4837-b69f-a59fb62ad90b (df837612-9227-4837-b69f-a59fb62ad90b): created successfully Aug 26 16:26:48 devstack sudo[112022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67f38bf-eed2-4eec-8b01-7167e25fc4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Flow 'volume_create_manager' (18577e3b-5b15-42fd-9c30-394da1f5ed9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:48 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-70f57fb0-8510-484d-9d3e-8cb0a199beb2 tempest-CreateVolumesFromImageTest-550300385 None] Created volume successfully. Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (1e88d1e2-79cf-4740-94b9-2edfb5532d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc553f2-033b-4628-82db-c13165abfe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc553f2-033b-4628-82db-c13165abfe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1408538251',display_name='tempest-VolumesGetTest-Volume-297741328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d268d3-08aa-4ddc-98f1-2e9441206082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853408d4a31a444db278c117d52838a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:48Z,use_quota=True,user_id='365c8a9f6dd44464a099fd592d79fa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4eea5d-3058-4f91-89d3-85ca4d77214e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4eea5d-3058-4f91-89d3-85ca4d77214e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ffbdd0-2c11-4500-aaee-818106275942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ffbdd0-2c11-4500-aaee-818106275942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d268d3-08aa-4ddc-98f1-2e9441206082', 'volume_name': 'volume-33d268d3-08aa-4ddc-98f1-2e9441206082', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d5f268-678c-452b-8d69-ac6cd4aee28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d5f268-678c-452b-8d69-ac6cd4aee28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86007d1-e2f7-4b40-81a3-34fbe31a0df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:48 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Volume 33d268d3-08aa-4ddc-98f1-2e9441206082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d268d3-08aa-4ddc-98f1-2e9441206082', 'volume_size': 1} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:48 devstack sudo[112022]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb 1073741824" returned: 0 in 0.485s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:48 devstack sudo[112028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb Aug 26 16:26:48 devstack sudo[112028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:48 devstack sudo[112028]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb" returned: 0 in 0.245s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.330s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1021744132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0582c2a5-147d-4ec7-87a1-2542e0615143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12764ec6b3fe41d2a3d0baf50b07e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:45Z,use_quota=True,user_id='1f7bebbe6f7c48bda880d92eccba9e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Creating volume 0582c2a5-147d-4ec7-87a1-2542e0615143 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:48 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0582c2a5-147d-4ec7-87a1-2542e0615143 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280802be-751b-4290-9c00-a2c14bd0a433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:48 devstack sudo[112031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0582c2a5-147d-4ec7-87a1-2542e0615143 1073741824 Aug 26 16:26:48 devstack sudo[112031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde50859-a4fe-43e6-af84-c01bc5920e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:48 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb (1b00f47e-1e3e-41ab-9be9-f83754694bcb): created successfully Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde50859-a4fe-43e6-af84-c01bc5920e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Flow 'volume_create_manager' (79c8d395-4c49-4340-9c30-c4bb6d8b8d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:48 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-84c06258-5299-423e-aeea-6fbd306a39af tempest-CreateVolumesFromSnapshotTest-1144838476 None] Created volume successfully. Aug 26 16:26:49 devstack sudo[112031]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0582c2a5-147d-4ec7-87a1-2542e0615143 1073741824" returned: 0 in 0.403s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0582c2a5-147d-4ec7-87a1-2542e0615143 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:49 devstack sudo[112037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0582c2a5-147d-4ec7-87a1-2542e0615143 Aug 26 16:26:49 devstack sudo[112037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:49 devstack sudo[112037]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0582c2a5-147d-4ec7-87a1-2542e0615143" returned: 0 in 0.256s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.067s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1363582566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc48f158-2917-4f67-aa5e-d0d042cee562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12764ec6b3fe41d2a3d0baf50b07e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:45Z,use_quota=True,user_id='1f7bebbe6f7c48bda880d92eccba9e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Creating volume dc48f158-2917-4f67-aa5e-d0d042cee562 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:49 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc48f158-2917-4f67-aa5e-d0d042cee562 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:49 devstack sudo[112040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc48f158-2917-4f67-aa5e-d0d042cee562 1073741824 Aug 26 16:26:49 devstack sudo[112040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a50519-2790-4665-889d-da7e2d89e467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0582c2a5-147d-4ec7-87a1-2542e0615143', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ef91e1-1318-4b95-8301-b8fb809a0a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:49 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Volume volume-0582c2a5-147d-4ec7-87a1-2542e0615143 (0582c2a5-147d-4ec7-87a1-2542e0615143): created successfully Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ef91e1-1318-4b95-8301-b8fb809a0a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Flow 'volume_create_manager' (4e5c1b87-a322-44d7-92f6-58931cdbc178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:49 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a7dc79bc-bcfc-435d-af8d-e60c2853102e tempest-CreateVolumesFromImageTest-550300385 None] Created volume successfully. Aug 26 16:26:50 devstack sudo[112040]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc48f158-2917-4f67-aa5e-d0d042cee562 1073741824" returned: 0 in 0.436s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc48f158-2917-4f67-aa5e-d0d042cee562 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:50 devstack sudo[112046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc48f158-2917-4f67-aa5e-d0d042cee562 Aug 26 16:26:50 devstack sudo[112046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:50 devstack sudo[112046]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc48f158-2917-4f67-aa5e-d0d042cee562" returned: 0 in 0.247s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.663s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eec1747-f6df-48d2-a314-4b99bbc0874c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75cf392d1a4d48219d2a801908e84360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:46Z,use_quota=True,user_id='21256fa1d71b460b91a62d7508b011b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Creating volume 9eec1747-f6df-48d2-a314-4b99bbc0874c {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:50 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9eec1747-f6df-48d2-a314-4b99bbc0874c 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc74257-2cd6-4a31-a302-33533d5ff180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc48f158-2917-4f67-aa5e-d0d042cee562', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:50 devstack sudo[112049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9eec1747-f6df-48d2-a314-4b99bbc0874c 1073741824 Aug 26 16:26:50 devstack sudo[112049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78874cdf-4956-41b0-9d0a-52fc3217fa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:50 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Volume volume-dc48f158-2917-4f67-aa5e-d0d042cee562 (dc48f158-2917-4f67-aa5e-d0d042cee562): created successfully Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78874cdf-4956-41b0-9d0a-52fc3217fa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Flow 'volume_create_manager' (ba3c6c3a-a02f-49f2-b5c5-a07b808e9c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:50 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-00ea2c2f-e11b-4a0f-9e6a-07f1e0a9e871 tempest-CreateVolumesFromImageTest-550300385 None] Created volume successfully. Aug 26 16:26:50 devstack sudo[112049]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9eec1747-f6df-48d2-a314-4b99bbc0874c 1073741824" returned: 0 in 0.440s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9eec1747-f6df-48d2-a314-4b99bbc0874c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:50 devstack sudo[112055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9eec1747-f6df-48d2-a314-4b99bbc0874c Aug 26 16:26:50 devstack sudo[112055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:51 devstack sudo[112055]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9eec1747-f6df-48d2-a314-4b99bbc0874c" returned: 0 in 0.232s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.338s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1374535715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf6634c-9860-46a3-9cf7-234b42261437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12764ec6b3fe41d2a3d0baf50b07e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:46Z,use_quota=True,user_id='1f7bebbe6f7c48bda880d92eccba9e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Creating volume ebf6634c-9860-46a3-9cf7-234b42261437 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:51 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ebf6634c-9860-46a3-9cf7-234b42261437 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76da8d3-8b3a-4e5e-bacf-e69cbd2cb470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eec1747-f6df-48d2-a314-4b99bbc0874c', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:51 devstack sudo[112058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ebf6634c-9860-46a3-9cf7-234b42261437 1073741824 Aug 26 16:26:51 devstack sudo[112058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7daba96a-9ae0-4cbf-9c41-017772710df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:51 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Volume volume-9eec1747-f6df-48d2-a314-4b99bbc0874c (9eec1747-f6df-48d2-a314-4b99bbc0874c): created successfully Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7daba96a-9ae0-4cbf-9c41-017772710df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Flow 'volume_create_manager' (dd2d0aaa-8838-4beb-9a63-7feba8ae93f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f89666ac-2e6c-401e-8c14-6e4d06f277fd tempest-CinderUnicodeTest-146533956 None] Created volume successfully. Aug 26 16:26:51 devstack sudo[112058]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ebf6634c-9860-46a3-9cf7-234b42261437 1073741824" returned: 0 in 0.395s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ebf6634c-9860-46a3-9cf7-234b42261437 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:51 devstack sudo[112064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ebf6634c-9860-46a3-9cf7-234b42261437 Aug 26 16:26:51 devstack sudo[112064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:51 devstack sudo[112064]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ebf6634c-9860-46a3-9cf7-234b42261437" returned: 0 in 0.238s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.399s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1408538251',display_name='tempest-VolumesGetTest-Volume-297741328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d268d3-08aa-4ddc-98f1-2e9441206082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853408d4a31a444db278c117d52838a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:48Z,use_quota=True,user_id='365c8a9f6dd44464a099fd592d79fa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Creating volume 33d268d3-08aa-4ddc-98f1-2e9441206082 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:51 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33d268d3-08aa-4ddc-98f1-2e9441206082 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a952ca-09fe-4773-8c34-77b7516a2ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf6634c-9860-46a3-9cf7-234b42261437', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:51 devstack sudo[112067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33d268d3-08aa-4ddc-98f1-2e9441206082 1073741824 Aug 26 16:26:51 devstack sudo[112067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bfe71a-98db-4ca0-945d-c79fe4a16779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:51 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Volume volume-ebf6634c-9860-46a3-9cf7-234b42261437 (ebf6634c-9860-46a3-9cf7-234b42261437): created successfully Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bfe71a-98db-4ca0-945d-c79fe4a16779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Flow 'volume_create_manager' (bb3e1b03-8afa-4782-879b-3d67d78e51a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5e8a786a-8217-4ab3-b357-75b5bed0eabb tempest-CreateVolumesFromImageTest-550300385 None] Created volume successfully. Aug 26 16:26:52 devstack sudo[112067]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33d268d3-08aa-4ddc-98f1-2e9441206082 1073741824" returned: 0 in 0.438s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33d268d3-08aa-4ddc-98f1-2e9441206082 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:52 devstack sudo[112073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33d268d3-08aa-4ddc-98f1-2e9441206082 Aug 26 16:26:52 devstack sudo[112073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Flow 'volume_create_manager' (24de7f77-cc51-4b63-9a71-1d97e8df62ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a1579a-7b4a-47b0-bdb6-d570d3f37cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:52 devstack sudo[112073]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33d268d3-08aa-4ddc-98f1-2e9441206082" returned: 0 in 0.273s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.979s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a1579a-7b4a-47b0-bdb6-d570d3f37cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1552822215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82794db7-3b83-45cc-8a44-57920b099dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75cf392d1a4d48219d2a801908e84360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:52Z,use_quota=True,user_id='21256fa1d71b460b91a62d7508b011b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a76e37c-eb5e-4062-9d62-981ce90fb43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a76e37c-eb5e-4062-9d62-981ce90fb43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b911da8-3ed4-4df3-869c-3fc01d877eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b911da8-3ed4-4df3-869c-3fc01d877eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82794db7-3b83-45cc-8a44-57920b099dd9', 'volume_name': 'volume-82794db7-3b83-45cc-8a44-57920b099dd9', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0944cd-ba4a-4a37-896d-aafe0d02dc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0944cd-ba4a-4a37-896d-aafe0d02dc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9936eb0-a564-4b62-b3ed-f82f2d39f693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:52 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Volume 82794db7-3b83-45cc-8a44-57920b099dd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82794db7-3b83-45cc-8a44-57920b099dd9', 'volume_size': 1} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86007d1-e2f7-4b40-81a3-34fbe31a0df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d268d3-08aa-4ddc-98f1-2e9441206082', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcab1ae3-ebe7-449e-95b6-d790cc1eda74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Creating offline snapshot 4f025b18-a7af-4e47-a636-f9325e79c990 of volume 1b00f47e-1e3e-41ab-9be9-f83754694bcb {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:26:52 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Volume volume-33d268d3-08aa-4ddc-98f1-2e9441206082 (33d268d3-08aa-4ddc-98f1-2e9441206082): created successfully Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcab1ae3-ebe7-449e-95b6-d790cc1eda74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (1e88d1e2-79cf-4740-94b9-2edfb5532d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cc6a4c-d1d6-41f2-80b1-de1e7493663b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:52 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-dcafa1b4-5f0d-4d51-b9e0-ae3cac0fd40e tempest-VolumesGetTest-454064183 None] Created volume successfully. Aug 26 16:26:52 devstack sudo[112076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb Aug 26 16:26:52 devstack sudo[112076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "cinder-ebf6634c-9860-46a3-9cf7-234b42261437-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-ebf6634c-9860-46a3-9cf7-234b42261437-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=137,cinder:UPDATE=148,cinder:INSERT=42,cinder:DELETE=12 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=122,cinder:UPDATE=151,cinder:INSERT=33,cinder:DELETE=13 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:26:53 devstack sudo[112076]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb" returned: 0 in 0.435s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "cinder-quobyte-ebf6634c-9860-46a3-9cf7-234b42261437" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-quobyte-ebf6634c-9860-46a3-9cf7-234b42261437" acquired by "delete_volume" :: waited 0.037s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:53 devstack sudo[112081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 1G Aug 26 16:26:53 devstack sudo[112081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f950185a-af42-496d-aab5-efcfb3ff05f5]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ebf6634c-9860-46a3-9cf7-234b42261437 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:53 devstack sudo[112083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ebf6634c-9860-46a3-9cf7-234b42261437 Aug 26 16:26:53 devstack sudo[112083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:53 devstack sudo[112081]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 1G" returned: 0 in 0.416s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:53 devstack sudo[112083]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ebf6634c-9860-46a3-9cf7-234b42261437" returned: 0 in 0.373s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ebf6634c-9860-46a3-9cf7-234b42261437 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:53 devstack sudo[112091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 Aug 26 16:26:53 devstack sudo[112091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:53 devstack sudo[112093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ebf6634c-9860-46a3-9cf7-234b42261437 Aug 26 16:26:53 devstack sudo[112093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-33d268d3-08aa-4ddc-98f1-2e9441206082-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Lock "cinder-33d268d3-08aa-4ddc-98f1-2e9441206082-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:53 devstack sudo[112093]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-quobyte-33d268d3-08aa-4ddc-98f1-2e9441206082" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ebf6634c-9860-46a3-9cf7-234b42261437" returned: 0 in 0.277s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-33d268d3-08aa-4ddc-98f1-2e9441206082" acquired by "delete_volume" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-quobyte-ebf6634c-9860-46a3-9cf7-234b42261437" released by "delete_volume" :: held 0.712s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[655514e8-9d2f-4f71-a1c7-43a38d0596cc]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33d268d3-08aa-4ddc-98f1-2e9441206082 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:53 devstack sudo[112091]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990" returned: 0 in 0.363s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:53 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 is being set with open permissions: ugo+rw Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:53 devstack sudo[112100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 Aug 26 16:26:53 devstack sudo[112100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:53 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Created reservations ['4b131a54-12b0-4a10-9e4a-4a973e495611', '759dd62a-1e5d-4e79-ae73-0a831e3c8e60', '3c918515-be54-4b5b-91b5-8c279f48bb1f', 'bd5ac35b-42b8-49c3-a811-32b089278d89'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:54 devstack sudo[112099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33d268d3-08aa-4ddc-98f1-2e9441206082 Aug 26 16:26:54 devstack sudo[112099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:54 devstack sudo[112103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:54 devstack sudo[112103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:54 devstack sudo[112100]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990" returned: 0 in 0.270s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "cinder-dc48f158-2917-4f67-aa5e-d0d042cee562-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:54 devstack sudo[112109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.info Aug 26 16:26:54 devstack sudo[112109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-dc48f158-2917-4f67-aa5e-d0d042cee562-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:54 devstack sudo[112099]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33d268d3-08aa-4ddc-98f1-2e9441206082" returned: 0 in 0.403s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33d268d3-08aa-4ddc-98f1-2e9441206082 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:54 devstack sudo[112114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33d268d3-08aa-4ddc-98f1-2e9441206082 Aug 26 16:26:54 devstack sudo[112114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:54 devstack sudo[112103]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.310s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "cinder-quobyte-dc48f158-2917-4f67-aa5e-d0d042cee562" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:54 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Deleted volume successfully. Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-quobyte-dc48f158-2917-4f67-aa5e-d0d042cee562" acquired by "delete_volume" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6da2d4ce-e9fc-4070-846e-0affa5b43369 tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-ebf6634c-9860-46a3-9cf7-234b42261437-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd4beb3-4639-4e12-a6ff-b151b7af3d00]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc48f158-2917-4f67-aa5e-d0d042cee562 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:54 devstack sudo[112109]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.info" returned: 0 in 0.297s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:54 devstack sudo[112116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc48f158-2917-4f67-aa5e-d0d042cee562 Aug 26 16:26:54 devstack sudo[112116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:54 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.info is being set with open permissions: ugo+rw Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:54 devstack sudo[112120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.info Aug 26 16:26:54 devstack sudo[112120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:54 devstack sudo[112114]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-33d268d3-08aa-4ddc-98f1-2e9441206082" returned: 0 in 0.303s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-33d268d3-08aa-4ddc-98f1-2e9441206082" released by "delete_volume" :: held 0.753s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Created reservations ['ea5f4856-881c-42f3-84cb-de05bc912af5', '43ee1399-cb96-4e94-be46-5b8e4e6b72cd', 'a426a80f-0ca3-46ee-9a5d-4af4ef4cd167', '33d7e4f6-b211-4800-8b5f-d65f70aba255'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:54 devstack sudo[112124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:54 devstack sudo[112124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:54 devstack sudo[112120]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.info" returned: 0 in 0.294s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:54 devstack sudo[112116]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.213s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1552822215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82794db7-3b83-45cc-8a44-57920b099dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75cf392d1a4d48219d2a801908e84360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:52Z,use_quota=True,user_id='21256fa1d71b460b91a62d7508b011b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Creating volume 82794db7-3b83-45cc-8a44-57920b099dd9 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:54 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc48f158-2917-4f67-aa5e-d0d042cee562" returned: 0 in 0.465s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc48f158-2917-4f67-aa5e-d0d042cee562 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:54 devstack sudo[112129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9 1073741824 Aug 26 16:26:54 devstack sudo[112129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:54 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9629e464-2198-4fc3-b624-b100adde99c2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Create snapshot completed successfully Aug 26 16:26:54 devstack sudo[112130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc48f158-2917-4f67-aa5e-d0d042cee562 Aug 26 16:26:54 devstack sudo[112130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:55 devstack sudo[112124]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.283s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Deleted volume successfully. Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-bcaff03e-89fa-4bfa-a11a-2a402b549206-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5824bd1d-80f1-4dd1-a52b-d4ad88d5bf69 tempest-VolumesGetTest-454064183 None] Lock "cinder-33d268d3-08aa-4ddc-98f1-2e9441206082-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Lock "cinder-bcaff03e-89fa-4bfa-a11a-2a402b549206-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-quobyte-bcaff03e-89fa-4bfa-a11a-2a402b549206" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-bcaff03e-89fa-4bfa-a11a-2a402b549206" acquired by "delete_volume" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f484b8-09e6-4178-af2f-0995da2ba0c3]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:55 devstack sudo[112130]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc48f158-2917-4f67-aa5e-d0d042cee562" returned: 0 in 0.307s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-quobyte-dc48f158-2917-4f67-aa5e-d0d042cee562" released by "delete_volume" :: held 0.824s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Created reservations ['73560094-1f02-47e8-9f55-d738f57121f8', 'c96eef06-0bbe-43d2-8e20-ec7bd60269b8', '55fd2f88-dcfe-47a7-9700-d948cee331a8', '1a931247-0c5d-4fee-93f0-f1184fdd671f'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:55 devstack sudo[112137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206 Aug 26 16:26:55 devstack sudo[112137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:55 devstack sudo[112140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:55 devstack sudo[112140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:55 devstack sudo[112129]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "cinder-0582c2a5-147d-4ec7-87a1-2542e0615143-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9 1073741824" returned: 0 in 0.578s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-0582c2a5-147d-4ec7-87a1-2542e0615143-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "cinder-quobyte-0582c2a5-147d-4ec7-87a1-2542e0615143" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-quobyte-0582c2a5-147d-4ec7-87a1-2542e0615143" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:55 devstack sudo[112144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9 Aug 26 16:26:55 devstack sudo[112144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[50872481-2f3c-4db7-ad2a-f25ffd673b91]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0582c2a5-147d-4ec7-87a1-2542e0615143 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:55 devstack sudo[112137]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206" returned: 0 in 0.450s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:55 devstack sudo[112140]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.321s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Deleted volume successfully. Aug 26 16:26:55 devstack sudo[112150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206 Aug 26 16:26:55 devstack sudo[112150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f216549-2583-45eb-97d8-f77771c2754c tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-dc48f158-2917-4f67-aa5e-d0d042cee562-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:55 devstack sudo[112148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0582c2a5-147d-4ec7-87a1-2542e0615143 Aug 26 16:26:55 devstack sudo[112148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:55 devstack sudo[112144]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9" returned: 0 in 0.313s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9936eb0-a564-4b62-b3ed-f82f2d39f693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82794db7-3b83-45cc-8a44-57920b099dd9', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bf1f25-b923-4871-b028-3fbae1b6cfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:55 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Volume volume-82794db7-3b83-45cc-8a44-57920b099dd9 (82794db7-3b83-45cc-8a44-57920b099dd9): created successfully Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bf1f25-b923-4871-b028-3fbae1b6cfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Flow 'volume_create_manager' (24de7f77-cc51-4b63-9a71-1d97e8df62ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-cd38d5ba-2be2-4829-af76-7e0e21bd456d tempest-CinderUnicodeTest-146533956 None] Created volume successfully. Aug 26 16:26:55 devstack sudo[112150]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bcaff03e-89fa-4bfa-a11a-2a402b549206" returned: 0 in 0.288s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-bcaff03e-89fa-4bfa-a11a-2a402b549206" released by "delete_volume" :: held 0.785s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:55 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Created reservations ['cd8a32f7-1a2e-4778-bf79-b9b93dd6a9d2', '500d39fb-cd22-40d5-b6b9-b1d7dec030cd', 'fa3b0fb7-cc36-4b54-a31b-5276abf5ab77', '99652e0b-f8e2-4616-be64-4b21bacef02e'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:56 devstack sudo[112148]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0582c2a5-147d-4ec7-87a1-2542e0615143" returned: 0 in 0.485s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0582c2a5-147d-4ec7-87a1-2542e0615143 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:56 devstack sudo[112158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0582c2a5-147d-4ec7-87a1-2542e0615143 Aug 26 16:26:56 devstack sudo[112158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:56 devstack sudo[112160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:56 devstack sudo[112160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-3e08b508-af04-4327-aca9-0131266e0315-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Lock "cinder-3e08b508-af04-4327-aca9-0131266e0315-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:56 devstack sudo[112158]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0582c2a5-147d-4ec7-87a1-2542e0615143" returned: 0 in 0.351s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-quobyte-0582c2a5-147d-4ec7-87a1-2542e0615143" released by "delete_volume" :: held 0.893s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:56 devstack sudo[112160]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.310s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:56 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Deleted volume successfully. Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-quobyte-3e08b508-af04-4327-aca9-0131266e0315" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-3e08b508-af04-4327-aca9-0131266e0315" acquired by "delete_volume" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-039fe8f3-55f8-4082-a6a0-27222fbece29 tempest-VolumesGetTest-454064183 None] Lock "cinder-bcaff03e-89fa-4bfa-a11a-2a402b549206-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[8050eda5-a809-4d69-b842-d484843e8b92]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Flow 'volume_create_manager' (290485ba-9966-4a33-92a1-5b3525b0d5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a739461c-c4ac-45ea-a6af-99d45a5911d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Created reservations ['f9e21859-1386-4ca4-9e24-ae395a7d0518', '83577118-4d86-4b4c-99d5-3d1d06dd40da', '0635e49e-6724-4cdc-8dc3-c1adc0c4658c', '8477e7a6-b6fa-4eb5-9a7e-586ea5eb58d7'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a739461c-c4ac-45ea-a6af-99d45a5911d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357299520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e53d795-a528-4e8d-958a-49e0f999eb1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72d02fe4b474765a580a1abc6625762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:56Z,use_quota=True,user_id='8cb2351d7c3a42a8a0994f82dccf755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ea28b1-6308-4625-88da-d7c2b497afd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ea28b1-6308-4625-88da-d7c2b497afd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e99804-f991-4ae2-b18f-6f3fd510a1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:56 devstack sudo[112164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 Aug 26 16:26:56 devstack sudo[112164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e99804-f991-4ae2-b18f-6f3fd510a1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e53d795-a528-4e8d-958a-49e0f999eb1f', 'volume_name': 'volume-5e53d795-a528-4e8d-958a-49e0f999eb1f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee7c964-e4ef-4298-89fc-d3f3ba906696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee7c964-e4ef-4298-89fc-d3f3ba906696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6ae1a9-f231-4fb3-b92e-dbf1a6a40f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:56 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume 5e53d795-a528-4e8d-958a-49e0f999eb1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e53d795-a528-4e8d-958a-49e0f999eb1f', 'volume_size': 1} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357299520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e53d795-a528-4e8d-958a-49e0f999eb1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72d02fe4b474765a580a1abc6625762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:56Z,use_quota=True,user_id='8cb2351d7c3a42a8a0994f82dccf755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Creating volume 5e53d795-a528-4e8d-958a-49e0f999eb1f {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:56 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5e53d795-a528-4e8d-958a-49e0f999eb1f 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:56 devstack sudo[112166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5e53d795-a528-4e8d-958a-49e0f999eb1f 1073741824 Aug 26 16:26:56 devstack sudo[112166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:56 devstack sudo[112168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:56 devstack sudo[112168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:57 devstack sudo[112164]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315" returned: 0 in 0.577s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:57 devstack sudo[112176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315 Aug 26 16:26:57 devstack sudo[112176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Flow 'volume_create_manager' (e1a98bcf-3343-41a3-bc83-4d5f3b03c3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5c1cfc-6ee4-4861-8604-4cd61ec63c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5c1cfc-6ee4-4861-8604-4cd61ec63c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2033703334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8365d1-14e6-47c6-9675-37c1473b77e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72d02fe4b474765a580a1abc6625762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:57Z,use_quota=True,user_id='8cb2351d7c3a42a8a0994f82dccf755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ec388e-918d-4c40-bce5-d7fb09946932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ec388e-918d-4c40-bce5-d7fb09946932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b45290-727a-4c65-8642-933e532fcb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b45290-727a-4c65-8642-933e532fcb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8365d1-14e6-47c6-9675-37c1473b77e7', 'volume_name': 'volume-2e8365d1-14e6-47c6-9675-37c1473b77e7', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84821f29-e8b4-4497-925e-6aebf6706118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84821f29-e8b4-4497-925e-6aebf6706118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:57 devstack sudo[112168]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b0a573-f91f-404a-a4d8-4b73495d91fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:57 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume 2e8365d1-14e6-47c6-9675-37c1473b77e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8365d1-14e6-47c6-9675-37c1473b77e7', 'volume_size': 1} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.423s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:57 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Deleted volume successfully. Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-dbecdcca-31bc-4b51-9010-40067a1489ba tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-0582c2a5-147d-4ec7-87a1-2542e0615143-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:57 devstack sudo[112166]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5e53d795-a528-4e8d-958a-49e0f999eb1f 1073741824" returned: 0 in 0.657s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5e53d795-a528-4e8d-958a-49e0f999eb1f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:57 devstack sudo[112179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5e53d795-a528-4e8d-958a-49e0f999eb1f Aug 26 16:26:57 devstack sudo[112179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:57 devstack sudo[112176]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e08b508-af04-4327-aca9-0131266e0315" returned: 0 in 0.362s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-3e08b508-af04-4327-aca9-0131266e0315" released by "delete_volume" :: held 1.038s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Flow 'volume_create_manager' (ac1bc5c1-edc5-4302-b6ca-2fd1d6e5ec0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4ec1ae-488f-4c96-b2dc-279a7381d883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Created reservations ['b505cbf7-0429-40d4-9855-622e468bdb96', 'd594df58-018c-4bb9-ba8a-1b7ca1392243', 'e3e17373-f62a-4cb1-b098-42bc845ffacc', '3038d6db-1e4d-4691-b72d-e499ff77a9f4'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4ec1ae-488f-4c96-b2dc-279a7381d883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2048691998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5776d1db-6c4f-4581-9be7-bf450dc6015b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72d02fe4b474765a580a1abc6625762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:58Z,use_quota=True,user_id='8cb2351d7c3a42a8a0994f82dccf755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74745fc5-73ef-4153-8b3c-127a61268279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74745fc5-73ef-4153-8b3c-127a61268279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d34bcc7-b990-4e67-95ea-8e60449565c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d34bcc7-b990-4e67-95ea-8e60449565c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5776d1db-6c4f-4581-9be7-bf450dc6015b', 'volume_name': 'volume-5776d1db-6c4f-4581-9be7-bf450dc6015b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefc37f3-2cd6-4dd2-9844-50f90262b494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:57 devstack sudo[112179]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefc37f3-2cd6-4dd2-9844-50f90262b494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ca5f76-ff22-484b-a3ad-30f23a179a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:57 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume 5776d1db-6c4f-4581-9be7-bf450dc6015b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5776d1db-6c4f-4581-9be7-bf450dc6015b', 'volume_size': 1} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5e53d795-a528-4e8d-958a-49e0f999eb1f" returned: 0 in 0.326s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2033703334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8365d1-14e6-47c6-9675-37c1473b77e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72d02fe4b474765a580a1abc6625762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:57Z,use_quota=True,user_id='8cb2351d7c3a42a8a0994f82dccf755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Creating volume 2e8365d1-14e6-47c6-9675-37c1473b77e7 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:26:57 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2e8365d1-14e6-47c6-9675-37c1473b77e7 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "cinder-df837612-9227-4837-b69f-a59fb62ad90b-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:57 devstack sudo[112183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2e8365d1-14e6-47c6-9675-37c1473b77e7 1073741824 Aug 26 16:26:57 devstack sudo[112183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6ae1a9-f231-4fb3-b92e-dbf1a6a40f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e53d795-a528-4e8d-958a-49e0f999eb1f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900fc5d8-c68f-4557-96eb-572db179d3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-df837612-9227-4837-b69f-a59fb62ad90b-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:57 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume volume-5e53d795-a528-4e8d-958a-49e0f999eb1f (5e53d795-a528-4e8d-958a-49e0f999eb1f): created successfully Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900fc5d8-c68f-4557-96eb-572db179d3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Flow 'volume_create_manager' (290485ba-9966-4a33-92a1-5b3525b0d5ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:57 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-026c623d-1c5c-49cc-b05e-04900273b774 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Created volume successfully. Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "cinder-quobyte-df837612-9227-4837-b69f-a59fb62ad90b" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-quobyte-df837612-9227-4837-b69f-a59fb62ad90b" acquired by "delete_volume" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:57 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc5f979-c048-455a-b0f7-5bad2fb23e96]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-df837612-9227-4837-b69f-a59fb62ad90b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:58 devstack sudo[112185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:58 devstack sudo[112185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Flow 'volume_create_manager' (1bb5c778-9a0b-4c1c-ac81-511c209a63da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0795b00-f597-4049-951d-78de39866e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0795b00-f597-4049-951d-78de39866e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1470892189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a0370d-87b7-425f-a172-0506880d2577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72d02fe4b474765a580a1abc6625762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:58Z,use_quota=True,user_id='8cb2351d7c3a42a8a0994f82dccf755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de148503-52fe-4047-8fa5-bedb613fbaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de148503-52fe-4047-8fa5-bedb613fbaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06290240-82ed-44ed-933c-af9f68895bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06290240-82ed-44ed-933c-af9f68895bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a0370d-87b7-425f-a172-0506880d2577', 'volume_name': 'volume-55a0370d-87b7-425f-a172-0506880d2577', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15dfa5ca-a6be-474e-80a9-7ef095f21381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15dfa5ca-a6be-474e-80a9-7ef095f21381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56260e48-b4da-40d2-b7e6-6965ddc26bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:58 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume 55a0370d-87b7-425f-a172-0506880d2577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a0370d-87b7-425f-a172-0506880d2577', 'volume_size': 1} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:58 devstack sudo[112186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-df837612-9227-4837-b69f-a59fb62ad90b Aug 26 16:26:58 devstack sudo[112186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:58 devstack sudo[112185]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.304s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:58 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Deleted volume successfully. Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df61154a-b947-4ff7-bb2f-9c8c15cc1478 tempest-VolumesGetTest-454064183 None] Lock "cinder-3e08b508-af04-4327-aca9-0131266e0315-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:58 devstack sudo[112183]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2e8365d1-14e6-47c6-9675-37c1473b77e7 1073741824" returned: 0 in 0.635s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2e8365d1-14e6-47c6-9675-37c1473b77e7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:58 devstack sudo[112193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2e8365d1-14e6-47c6-9675-37c1473b77e7 Aug 26 16:26:58 devstack sudo[112193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Flow 'volume_create_manager' (906c9944-64cf-4b9a-a10e-c3333457182b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18982b20-75f8-4668-9128-98236b3d09fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:58 devstack sudo[112186]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18982b20-75f8-4668-9128-98236b3d09fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-16840342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b8f909-2a9c-4838-a72d-418c6d5e24d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72d02fe4b474765a580a1abc6625762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:58Z,use_quota=True,user_id='8cb2351d7c3a42a8a0994f82dccf755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b812f1-388b-44f7-9d22-79df20300c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b812f1-388b-44f7-9d22-79df20300c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99c3733-c3fd-41d3-b5ed-29f9825f9377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99c3733-c3fd-41d3-b5ed-29f9825f9377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b8f909-2a9c-4838-a72d-418c6d5e24d3', 'volume_name': 'volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546d3f4a-0348-4449-8896-715e798d9618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546d3f4a-0348-4449-8896-715e798d9618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd6e065-7401-4116-ab24-f1b312341e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:58 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume a4b8f909-2a9c-4838-a72d-418c6d5e24d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3', 'volume_size': 1} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-df837612-9227-4837-b69f-a59fb62ad90b" returned: 0 in 0.556s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-df837612-9227-4837-b69f-a59fb62ad90b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:58 devstack sudo[112198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-df837612-9227-4837-b69f-a59fb62ad90b Aug 26 16:26:58 devstack sudo[112198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:58 devstack sudo[112193]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2e8365d1-14e6-47c6-9675-37c1473b77e7" returned: 0 in 0.305s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.450s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] Creating offline snapshot 7ea8571b-d788-40e0-a1e0-e9eb6991e089 of volume 82794db7-3b83-45cc-8a44-57920b099dd9 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f187c052-6335-49e2-9154-8313c17b6bf2]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b0a573-f91f-404a-a4d8-4b73495d91fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8365d1-14e6-47c6-9675-37c1473b77e7', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c1364e-7846-4168-8eae-8eeead27061c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:58 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume volume-2e8365d1-14e6-47c6-9675-37c1473b77e7 (2e8365d1-14e6-47c6-9675-37c1473b77e7): created successfully Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c1364e-7846-4168-8eae-8eeead27061c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Flow 'volume_create_manager' (e1a98bcf-3343-41a3-bc83-4d5f3b03c3b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:58 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-853fd971-8135-4176-b5a9-eb2dab91b839 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Created volume successfully. Aug 26 16:26:58 devstack sudo[112198]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-df837612-9227-4837-b69f-a59fb62ad90b" returned: 0 in 0.360s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-quobyte-df837612-9227-4837-b69f-a59fb62ad90b" released by "delete_volume" :: held 0.994s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:58 devstack sudo[112201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9 Aug 26 16:26:58 devstack sudo[112201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:58 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Created reservations ['71dd657d-cda8-417a-9214-53b536433022', '989e4d07-2d4c-4b8b-ade4-ffebd7569503', '9a27be01-5014-4de0-948f-d37875114ee4', '9f551d87-b8e1-4cd1-9894-c114f68d1f21'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:59 devstack sudo[112204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:26:59 devstack sudo[112204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:59 devstack sudo[112201]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9" returned: 0 in 0.471s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:59 devstack sudo[112209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 1G Aug 26 16:26:59 devstack sudo[112209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:59 devstack sudo[112204]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.305s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:26:59 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Deleted volume successfully. Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (c7dd9055-fac2-430b-8985-2450b5508263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2836ad-f10e-476f-9e85-60234b8fa187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2836ad-f10e-476f-9e85-60234b8fa187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-361957121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a27a6b-06a1-4555-a713-b1e6e72f6ee5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='853408d4a31a444db278c117d52838a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:59Z,use_quota=True,user_id='365c8a9f6dd44464a099fd592d79fa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a85574-a0d7-4f5c-8c45-08290b039c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a85574-a0d7-4f5c-8c45-08290b039c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb9ef65-b51a-401f-8484-4af2db7461f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.image.glance [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Creating Keystone auth plugin from conf {{(pid=94407) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-da4c67da-6cc5-4af5-b6db-e440c9cf6da5 tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-df837612-9227-4837-b69f-a59fb62ad90b-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:26:59 devstack sudo[112209]: pam_unix(sudo:session): session closed for user root Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 1G" returned: 0 in 0.444s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82794db7-3b83-45cc-8a44-57920b099dd9 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:26:59 devstack sudo[112216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82794db7-3b83-45cc-8a44-57920b099dd9 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 Aug 26 16:26:59 devstack sudo[112216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb9ef65-b51a-401f-8484-4af2db7461f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9a27a6b-06a1-4555-a713-b1e6e72f6ee5', 'volume_name': 'volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0056ebee-c0df-44f5-8791-4459468599d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0056ebee-c0df-44f5-8791-4459468599d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18628c6c-3d9e-426a-b607-9bda6ea8a64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:26:59 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Volume f9a27a6b-06a1-4555-a713-b1e6e72f6ee5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 16:26:59 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Trying to clone f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 from image 6ac3a618-4ad2-4833-9626-12a425ebacfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]). {{(pid=94407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "cinder-62d262b8-e13d-40f5-bb3d-9428ee63e78f-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-62d262b8-e13d-40f5-bb3d-9428ee63e78f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:00 devstack sudo[112216]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82794db7-3b83-45cc-8a44-57920b099dd9 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089" returned: 0 in 0.413s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:00 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 is being set with open permissions: ugo+rw Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:00 devstack sudo[112221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 Aug 26 16:27:00 devstack sudo[112221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "cinder-quobyte-62d262b8-e13d-40f5-bb3d-9428ee63e78f" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-quobyte-62d262b8-e13d-40f5-bb3d-9428ee63e78f" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 16:27:00 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Image download 20.69 MB at 20.69 MB/s Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1f032e-875d-4998-a59e-c073199aef81]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4e2b68-5063-45f4-9285-4402c58ab22a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:00 devstack sudo[112224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f Aug 26 16:27:00 devstack sudo[112224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:00 devstack sudo[112221]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089" returned: 0 in 0.316s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:00 devstack sudo[112225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD Aug 26 16:27:00 devstack sudo[112225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:00 devstack sudo[112229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.info Aug 26 16:27:00 devstack sudo[112229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:00 devstack sudo[112224]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f" returned: 0 in 0.399s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:00 devstack sudo[112225]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Temporary image 6ac3a618-4ad2-4833-9626-12a425ebacfd is fetched for user 365c8a9f6dd44464a099fd592d79fa30. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 16:27:00 devstack sudo[112237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f Aug 26 16:27:00 devstack sudo[112237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:00 devstack sudo[112229]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.info" returned: 0 in 0.278s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:00 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.info is being set with open permissions: ugo+rw Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fee081-1d97-4cf7-83e1-86d93f53e609]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:00 devstack sudo[112240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.info Aug 26 16:27:00 devstack sudo[112240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:00 devstack sudo[112241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD Aug 26 16:27:00 devstack sudo[112241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:00 devstack sudo[112237]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62d262b8-e13d-40f5-bb3d-9428ee63e78f" returned: 0 in 0.260s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-quobyte-62d262b8-e13d-40f5-bb3d-9428ee63e78f" released by "delete_volume" :: held 0.715s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:00 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Created reservations ['ecc07350-2ad5-458d-865f-7511bb0bd4b4', '0628d64a-8930-45c9-bfec-2b67bf20bb7e', '223fac01-a077-44d2-a4a0-fa1ffb7d0c87', '46e4d014-c76a-450c-8c19-078ff9c56f13'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:01 devstack sudo[112240]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.info" returned: 0 in 0.265s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.296s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.314s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2048691998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5776d1db-6c4f-4581-9be7-bf450dc6015b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72d02fe4b474765a580a1abc6625762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:58Z,use_quota=True,user_id='8cb2351d7c3a42a8a0994f82dccf755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Creating volume 5776d1db-6c4f-4581-9be7-bf450dc6015b {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:01 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5776d1db-6c4f-4581-9be7-bf450dc6015b 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:01 devstack sudo[112246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5776d1db-6c4f-4581-9be7-bf450dc6015b 1073741824 Aug 26 16:27:01 devstack sudo[112246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-dcd68913-8a62-4e87-abdc-62a71e5f28e1 tempest-CinderUnicodeTest-146533956 None] Create snapshot completed successfully Aug 26 16:27:01 devstack sudo[112241]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:01 devstack sudo[112251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:01 devstack sudo[112251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:01 devstack sudo[112251]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.286s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Deleted volume successfully. Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-dc9d80fd-0b62-40a3-b7bd-a1e6021a147e tempest-CreateVolumesFromImageTest-550300385 None] Lock "cinder-62d262b8-e13d-40f5-bb3d-9428ee63e78f-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Acquiring lock "cinder-7ea8571b-d788-40e0-a1e0-e9eb6991e089-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Lock "cinder-7ea8571b-d788-40e0-a1e0-e9eb6991e089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Acquiring lock "cinder-quobyte-82794db7-3b83-45cc-8a44-57920b099dd9" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Lock "cinder-quobyte-82794db7-3b83-45cc-8a44-57920b099dd9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Acquiring lock "cinder-quobyte-7ea8571b-d788-40e0-a1e0-e9eb6991e089" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Lock "cinder-quobyte-7ea8571b-d788-40e0-a1e0-e9eb6991e089" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Deleting offline snapshot 7ea8571b-d788-40e0-a1e0-e9eb6991e089 of volume 82794db7-3b83-45cc-8a44-57920b099dd9 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] snapshot_file for this snap is: volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[845c1ed1-a439-4cc4-9c27-f254fab56fc3]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:01 devstack sudo[112246]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5776d1db-6c4f-4581-9be7-bf450dc6015b 1073741824" returned: 0 in 0.536s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5776d1db-6c4f-4581-9be7-bf450dc6015b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:01 devstack sudo[112259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5776d1db-6c4f-4581-9be7-bf450dc6015b Aug 26 16:27:01 devstack sudo[112259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:01 devstack sudo[112258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 Aug 26 16:27:01 devstack sudo[112258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:01 devstack sudo[112259]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5776d1db-6c4f-4581-9be7-bf450dc6015b" returned: 0 in 0.269s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.689s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1470892189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a0370d-87b7-425f-a172-0506880d2577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72d02fe4b474765a580a1abc6625762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:58Z,use_quota=True,user_id='8cb2351d7c3a42a8a0994f82dccf755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Creating volume 55a0370d-87b7-425f-a172-0506880d2577 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:01 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-55a0370d-87b7-425f-a172-0506880d2577 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ca5f76-ff22-484b-a3ad-30f23a179a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5776d1db-6c4f-4581-9be7-bf450dc6015b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22142017-e2ad-4756-9515-4a6c9927ec4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:01 devstack sudo[112266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-55a0370d-87b7-425f-a172-0506880d2577 1073741824 Aug 26 16:27:01 devstack sudo[112266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:01 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume volume-5776d1db-6c4f-4581-9be7-bf450dc6015b (5776d1db-6c4f-4581-9be7-bf450dc6015b): created successfully Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22142017-e2ad-4756-9515-4a6c9927ec4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Flow 'volume_create_manager' (ac1bc5c1-edc5-4302-b6ca-2fd1d6e5ec0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:01 devstack sudo[112258]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089" returned: 0 in 0.422s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82794db7-3b83-45cc-8a44-57920b099dd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:27:02 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6416042b-afd4-46fd-8647-a3334246fee8 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Created volume successfully. Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f545ad9-f22e-424b-b6bb-ffa48702343f]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:02 devstack sudo[112269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9 Aug 26 16:27:02 devstack sudo[112269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:02 devstack sudo[112266]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-55a0370d-87b7-425f-a172-0506880d2577 1073741824" returned: 0 in 0.525s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:02 devstack sudo[112269]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9" returned: 0 in 0.426s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:02 devstack sudo[112280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 Aug 26 16:27:02 devstack sudo[112280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-55a0370d-87b7-425f-a172-0506880d2577 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:02 devstack sudo[112282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-55a0370d-87b7-425f-a172-0506880d2577 Aug 26 16:27:02 devstack sudo[112282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:02 devstack sudo[112282]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-55a0370d-87b7-425f-a172-0506880d2577" returned: 0 in 0.364s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.331s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-16840342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b8f909-2a9c-4838-a72d-418c6d5e24d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72d02fe4b474765a580a1abc6625762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:58Z,use_quota=True,user_id='8cb2351d7c3a42a8a0994f82dccf755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Creating volume a4b8f909-2a9c-4838-a72d-418c6d5e24d3 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:02 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:02 devstack sudo[112289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3 1073741824 Aug 26 16:27:02 devstack sudo[112289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56260e48-b4da-40d2-b7e6-6965ddc26bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a0370d-87b7-425f-a172-0506880d2577', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:02 devstack sudo[112280]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4274def7-0d1b-42d0-8b95-e77ab0418d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089" returned: 0 in 0.532s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:03 devstack sudo[112291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089 Aug 26 16:27:03 devstack sudo[112291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:03 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume volume-55a0370d-87b7-425f-a172-0506880d2577 (55a0370d-87b7-425f-a172-0506880d2577): created successfully Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4274def7-0d1b-42d0-8b95-e77ab0418d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Flow 'volume_create_manager' (1bb5c778-9a0b-4c1c-ac81-511c209a63da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:03 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-1d85890f-bf49-451c-87ed-6d6346327334 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Created volume successfully. Aug 26 16:27:03 devstack sudo[112291]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9.7ea8571b-d788-40e0-a1e0-e9eb6991e089" returned: 0 in 0.269s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Lock "cinder-quobyte-7ea8571b-d788-40e0-a1e0-e9eb6991e089" released by "_delete_snapshot" :: held 1.789s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Lock "cinder-quobyte-82794db7-3b83-45cc-8a44-57920b099dd9" released by "delete_snapshot" :: held 1.820s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Created reservations ['31fa77a6-58e4-40f4-b38d-ec3e71c9f492', '449c7b3c-e175-4881-8b46-9577fe8ff95d', '59999423-3edc-4870-a060-b65c5532a399', 'decbd0b3-b589-4e5a-af4a-d6bb6bd4d57b'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:03 devstack sudo[112289]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3 1073741824" returned: 0 in 0.511s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:03 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Delete snapshot completed successfully. Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-4030cfd7-afb7-4bb4-93f9-d4c31eae99e1 tempest-CinderUnicodeTest-146533956 None] Lock "cinder-7ea8571b-d788-40e0-a1e0-e9eb6991e089-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:03 devstack sudo[112298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3 Aug 26 16:27:03 devstack sudo[112298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Acquiring lock "cinder-82794db7-3b83-45cc-8a44-57920b099dd9-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Lock "cinder-82794db7-3b83-45cc-8a44-57920b099dd9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:03 devstack sudo[112298]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3" returned: 0 in 0.295s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.654s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-361957121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a27a6b-06a1-4555-a713-b1e6e72f6ee5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='853408d4a31a444db278c117d52838a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:26:59Z,use_quota=True,user_id='365c8a9f6dd44464a099fd592d79fa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Creating volume f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:03 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Acquiring lock "cinder-quobyte-82794db7-3b83-45cc-8a44-57920b099dd9" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:03 devstack sudo[112301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 1073741824 Aug 26 16:27:03 devstack sudo[112301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd6e065-7401-4116-ab24-f1b312341e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7adc1d4-e442-4895-9cbe-a0d043488d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Lock "cinder-quobyte-82794db7-3b83-45cc-8a44-57920b099dd9" acquired by "delete_volume" :: waited 0.051s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f453a4dd-63a2-494c-b52e-ae132ae5044e]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:03 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Volume volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3 (a4b8f909-2a9c-4838-a72d-418c6d5e24d3): created successfully Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7adc1d4-e442-4895-9cbe-a0d043488d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Flow 'volume_create_manager' (906c9944-64cf-4b9a-a10e-c3333457182b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:04 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a87bab61-41e4-4569-adca-d9924048e6f2 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Created volume successfully. Aug 26 16:27:04 devstack sudo[112303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9 Aug 26 16:27:04 devstack sudo[112303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-a4b8f909-2a9c-4838-a72d-418c6d5e24d3-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-a4b8f909-2a9c-4838-a72d-418c6d5e24d3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-quobyte-a4b8f909-2a9c-4838-a72d-418c6d5e24d3" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-a4b8f909-2a9c-4838-a72d-418c6d5e24d3" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad1ffc2-9ec1-41f5-9f04-646560308bc9]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:04 devstack sudo[112301]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 1073741824" returned: 0 in 0.574s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:04 devstack sudo[112303]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9" returned: 0 in 0.475s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:04 devstack sudo[112313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9 Aug 26 16:27:04 devstack sudo[112313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:04 devstack sudo[112309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3 Aug 26 16:27:04 devstack sudo[112309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:04 devstack sudo[112316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 Aug 26 16:27:04 devstack sudo[112316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:04 devstack sudo[112313]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-82794db7-3b83-45cc-8a44-57920b099dd9" returned: 0 in 0.304s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Lock "cinder-quobyte-82794db7-3b83-45cc-8a44-57920b099dd9" released by "delete_volume" :: held 0.864s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:04 devstack sudo[112316]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5" returned: 0 in 0.349s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Created reservations ['f9fbd477-d039-4755-8ccb-b3091944f58f', '8c40f95d-c7df-4582-bb8c-f3d0d38e6a49', '7be35f5b-1d17-4bf5-98a9-72b08b77825e', '9d0b780e-29b6-4dda-9f80-0c6a5f5e4b54'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:04 devstack sudo[112309]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3" returned: 0 in 0.520s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:04 devstack sudo[112325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3 Aug 26 16:27:04 devstack sudo[112325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Attempting download of 6ac3a618-4ad2-4833-9626-12a425ebacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}])) to volume f9a27a6b-06a1-4555-a713-b1e6e72f6ee5. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Flow 'volume_create_manager' (64ce0f6a-3f90-4251-917f-f112ac300875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb82d8a8-8ff3-4807-93fd-c0350038383b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb82d8a8-8ff3-4807-93fd-c0350038383b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574066027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d2d659-ab9f-4a70-8669-eccf6ac3e58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b552f40b7044d2cacb5ab8f327e50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:05Z,use_quota=True,user_id='38710b6adaee4a95a60f4bc2ff4dd112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc1c2fc-18b4-405f-937e-375893f4dc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc1c2fc-18b4-405f-937e-375893f4dc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedef16a-ac98-4851-8fe5-9e4c4a4fc3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedef16a-ac98-4851-8fe5-9e4c4a4fc3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d2d659-ab9f-4a70-8669-eccf6ac3e58d', 'volume_name': 'volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f96a42-3813-48fc-9b93-cd767988a64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f96a42-3813-48fc-9b93-cd767988a64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ad2bb7-2f57-4225-87ed-ad1d05ed45ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:04 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume 01d2d659-ab9f-4a70-8669-eccf6ac3e58d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d', 'volume_size': 1} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574066027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d2d659-ab9f-4a70-8669-eccf6ac3e58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b552f40b7044d2cacb5ab8f327e50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:05Z,use_quota=True,user_id='38710b6adaee4a95a60f4bc2ff4dd112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Creating volume 01d2d659-ab9f-4a70-8669-eccf6ac3e58d {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:04 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c94d18-c18e-42a0-9333-b2606e6f1fcd]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_n12_jnfq {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:05 devstack sudo[112327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d 1073741824 Aug 26 16:27:05 devstack sudo[112327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:05 devstack sudo[112331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:05 devstack sudo[112331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:05 devstack sudo[112325]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4b8f909-2a9c-4838-a72d-418c6d5e24d3" returned: 0 in 0.286s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-a4b8f909-2a9c-4838-a72d-418c6d5e24d3" released by "delete_volume" :: held 0.849s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:05 devstack sudo[112328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_n12_jnfq Aug 26 16:27:05 devstack sudo[112328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Created reservations ['b0d4174a-8659-4d55-b5ec-aa5ae537be18', '06eeb9e7-300a-4152-b168-8e48a103056b', '6f78c568-6ada-4d49-a378-f43ff17e3a8b', 'b1eccdb2-c530-4377-990c-adbea53b3f8b'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:05 devstack sudo[112337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:05 devstack sudo[112337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:05 devstack sudo[112328]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_n12_jnfq" returned: 0 in 0.361s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_n12_jnfq {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:05 devstack sudo[112331]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-55a0370d-87b7-425f-a172-0506880d2577-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.352s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:05 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Deleted volume successfully. Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-55a0370d-87b7-425f-a172-0506880d2577-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8b31521d-ddc3-411c-9554-b4a350be735a tempest-CinderUnicodeTest-146533956 None] Lock "cinder-82794db7-3b83-45cc-8a44-57920b099dd9-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-quobyte-55a0370d-87b7-425f-a172-0506880d2577" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-55a0370d-87b7-425f-a172-0506880d2577" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[704e96c3-f0b9-4f83-9cf5-285db2b3fea8]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-55a0370d-87b7-425f-a172-0506880d2577 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:05 devstack sudo[112342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_n12_jnfq Aug 26 16:27:05 devstack sudo[112342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:05 devstack sudo[112327]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d 1073741824" returned: 0 in 0.597s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:05 devstack sudo[112345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-55a0370d-87b7-425f-a172-0506880d2577 Aug 26 16:27:05 devstack sudo[112345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:05 devstack sudo[112347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d Aug 26 16:27:05 devstack sudo[112347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:05 devstack sudo[112337]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.367s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:05 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Deleted volume successfully. Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0adde817-5d98-4cf8-9686-89a85f72f219 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-a4b8f909-2a9c-4838-a72d-418c6d5e24d3-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:05 devstack sudo[112342]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_n12_jnfq" returned: 1 in 0.426s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ac3a618-4ad2-4833-9626-12a425ebacfd_n12_jnfq' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[76db3677-20a7-4466-88c3-65605cd5eeac]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:05 devstack sudo[112352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD Aug 26 16:27:05 devstack sudo[112345]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:05 devstack sudo[112352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-55a0370d-87b7-425f-a172-0506880d2577" returned: 0 in 0.396s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-55a0370d-87b7-425f-a172-0506880d2577 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:05 devstack sudo[112358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-55a0370d-87b7-425f-a172-0506880d2577 Aug 26 16:27:05 devstack sudo[112358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Acquiring lock "cinder-9eec1747-f6df-48d2-a314-4b99bbc0874c-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:06 devstack sudo[112347]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d" returned: 0 in 0.403s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Lock "cinder-9eec1747-f6df-48d2-a314-4b99bbc0874c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ad2bb7-2f57-4225-87ed-ad1d05ed45ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c91bb8-e6a5-4e91-92ba-30b4dd18c1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:06 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d (01d2d659-ab9f-4a70-8669-eccf6ac3e58d): created successfully Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c91bb8-e6a5-4e91-92ba-30b4dd18c1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Flow 'volume_create_manager' (64ce0f6a-3f90-4251-917f-f112ac300875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Acquiring lock "cinder-quobyte-9eec1747-f6df-48d2-a314-4b99bbc0874c" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-1a83ef80-176c-4879-98e8-1a9dcca55322 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Created volume successfully. Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Lock "cinder-quobyte-9eec1747-f6df-48d2-a314-4b99bbc0874c" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:06 devstack sudo[112352]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] 6ac3a618-4ad2-4833-9626-12a425ebacfd was qcow2, converting to qcow2 {{(pid=94407) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8049b3a-fd17-4ddc-bcc7-baa33fad2f27]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9eec1747-f6df-48d2-a314-4b99bbc0874c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:06 devstack sudo[112365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 Aug 26 16:27:06 devstack sudo[112365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:06 devstack sudo[112358]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-55a0370d-87b7-425f-a172-0506880d2577" returned: 0 in 0.306s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-55a0370d-87b7-425f-a172-0506880d2577" released by "delete_volume" :: held 0.748s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:06 devstack sudo[112366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9eec1747-f6df-48d2-a314-4b99bbc0874c Aug 26 16:27:06 devstack sudo[112366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Created reservations ['c059e4f0-a55c-43e0-adfa-04b6c9754c73', '0e5e217c-261e-4449-a55a-ccf73677d4c8', 'b66c59a9-b762-4e6b-b6d1-fb24f14a48ab', 'c3bc5650-b3fa-4531-9d91-9f13b86a39bd'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:06 devstack sudo[112369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:06 devstack sudo[112369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:06 devstack sudo[112366]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9eec1747-f6df-48d2-a314-4b99bbc0874c" returned: 0 in 0.372s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9eec1747-f6df-48d2-a314-4b99bbc0874c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:06 devstack sudo[112384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9eec1747-f6df-48d2-a314-4b99bbc0874c Aug 26 16:27:06 devstack sudo[112384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-5776d1db-6c4f-4581-9be7-bf450dc6015b-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:06 devstack sudo[112369]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-5776d1db-6c4f-4581-9be7-bf450dc6015b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.309s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Deleted volume successfully. Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0e6917bf-18c0-4055-bac2-eabce85bf8ff tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-55a0370d-87b7-425f-a172-0506880d2577-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-quobyte-5776d1db-6c4f-4581-9be7-bf450dc6015b" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-5776d1db-6c4f-4581-9be7-bf450dc6015b" acquired by "delete_volume" :: waited 0.014s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78d5c58-aa90-4c37-a377-b238f97151f9]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5776d1db-6c4f-4581-9be7-bf450dc6015b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:06 devstack sudo[112384]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:06 devstack sudo[112387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5776d1db-6c4f-4581-9be7-bf450dc6015b Aug 26 16:27:06 devstack sudo[112387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9eec1747-f6df-48d2-a314-4b99bbc0874c" returned: 0 in 0.343s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Lock "cinder-quobyte-9eec1747-f6df-48d2-a314-4b99bbc0874c" released by "delete_volume" :: held 0.785s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:06 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Created reservations ['85190fcf-7195-4fb6-a411-49535c59561b', '5cbc662d-7d31-41c1-a14f-ba89c96a1005', '73f5def5-ad98-423e-8bba-1663cb71a99d', 'a517a27b-d599-403c-9fcc-6bcc557f84b7'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:07 devstack sudo[112390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:07 devstack sudo[112390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:07 devstack sudo[112387]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5776d1db-6c4f-4581-9be7-bf450dc6015b" returned: 0 in 0.547s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5776d1db-6c4f-4581-9be7-bf450dc6015b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:07 devstack sudo[112397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5776d1db-6c4f-4581-9be7-bf450dc6015b Aug 26 16:27:07 devstack sudo[112397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:07 devstack sudo[112390]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.335s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:07 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Deleted volume successfully. Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f86572c4-c7eb-4bcf-8146-f98a080ca2f8 tempest-CinderUnicodeTest-146533956 None] Lock "cinder-9eec1747-f6df-48d2-a314-4b99bbc0874c-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:07 devstack sudo[112397]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Flow 'volume_create_manager' (1ca8f801-6aa2-482a-97d3-686ba5fcd39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad89452-a3e3-46d0-99f9-7139017bac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5776d1db-6c4f-4581-9be7-bf450dc6015b" returned: 0 in 0.405s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad89452-a3e3-46d0-99f9-7139017bac52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-492857238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4fb76a-4a48-4d03-a3a2-724cda5552d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b552f40b7044d2cacb5ab8f327e50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:08Z,use_quota=True,user_id='38710b6adaee4a95a60f4bc2ff4dd112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3336a9dc-e00c-4756-8708-76287f520ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3336a9dc-e00c-4756-8708-76287f520ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d00b80-2d99-4c98-94d6-4df6103ce8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d00b80-2d99-4c98-94d6-4df6103ce8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4fb76a-4a48-4d03-a3a2-724cda5552d6', 'volume_name': 'volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c5677e-4343-4fd5-b798-929cddb3f0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c5677e-4343-4fd5-b798-929cddb3f0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8546f5-c7a0-49d4-bc8f-9d0d2aacbb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:07 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume 2c4fb76a-4a48-4d03-a3a2-724cda5552d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6', 'volume_size': 1} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-492857238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4fb76a-4a48-4d03-a3a2-724cda5552d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b552f40b7044d2cacb5ab8f327e50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:08Z,use_quota=True,user_id='38710b6adaee4a95a60f4bc2ff4dd112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Creating volume 2c4fb76a-4a48-4d03-a3a2-724cda5552d6 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:07 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-5776d1db-6c4f-4581-9be7-bf450dc6015b" released by "delete_volume" :: held 1.084s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:07 devstack sudo[112400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6 1073741824 Aug 26 16:27:07 devstack sudo[112400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:07 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Created reservations ['99f60de8-d438-4059-b3dc-98d77c7dbebc', 'b3b8d8fc-2450-4739-a0c5-fd4d650e9810', '7617557a-47de-4b7b-abb3-eea181612b69', '0ec6927f-6d50-4539-808b-cd956981c5eb'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:08 devstack sudo[112403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:08 devstack sudo[112403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Flow 'volume_create_manager' (bfd97b5b-258b-40d5-87ee-b79e29662bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0815d0f6-a2cd-4c99-8fcd-56562ccf0a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0815d0f6-a2cd-4c99-8fcd-56562ccf0a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1027339505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbeb2be-9be7-4d19-8524-327cb2b69f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b552f40b7044d2cacb5ab8f327e50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:08Z,use_quota=True,user_id='38710b6adaee4a95a60f4bc2ff4dd112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0296bf1-6224-4362-afd5-f4d2cd41154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0296bf1-6224-4362-afd5-f4d2cd41154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af652df3-9e91-441c-85b3-172e32ca8f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af652df3-9e91-441c-85b3-172e32ca8f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adbeb2be-9be7-4d19-8524-327cb2b69f21', 'volume_name': 'volume-adbeb2be-9be7-4d19-8524-327cb2b69f21', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b4c01b-538c-4e68-8f4d-6892eb0b9f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b4c01b-538c-4e68-8f4d-6892eb0b9f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ed02e7-d0f5-4df9-8a2d-e27c0e75d74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:08 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume adbeb2be-9be7-4d19-8524-327cb2b69f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adbeb2be-9be7-4d19-8524-327cb2b69f21', 'volume_size': 1} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:08 devstack sudo[112365]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5" returned: 0 in 2.254s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ac3a618-4ad2-4833-9626-12a425ebacfd_py2btr60devstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:27:08 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Converted 112.00 MB image at 49.66 MB/s Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:08 devstack sudo[112408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 1G Aug 26 16:27:08 devstack sudo[112408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:08 devstack sudo[112400]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6 1073741824" returned: 0 in 0.728s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:08 devstack sudo[112403]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.464s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Deleted volume successfully. Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-706927fc-caed-4bc3-b4fd-894891a43603 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-5776d1db-6c4f-4581-9be7-bf450dc6015b-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:08 devstack sudo[112411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6 Aug 26 16:27:08 devstack sudo[112411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Flow 'volume_create_manager' (7f872488-367b-4b25-8f8f-a75a9f106f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48177f23-552c-46ae-899c-48b009ec8622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48177f23-552c-46ae-899c-48b009ec8622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046023074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937ba806-7959-404d-91c4-fe98fe2be8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b552f40b7044d2cacb5ab8f327e50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:09Z,use_quota=True,user_id='38710b6adaee4a95a60f4bc2ff4dd112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f4429e-00fd-47d4-8498-6399c241b5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f4429e-00fd-47d4-8498-6399c241b5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaca14a1-2c0d-4083-8da4-21dde07e04ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaca14a1-2c0d-4083-8da4-21dde07e04ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '937ba806-7959-404d-91c4-fe98fe2be8b1', 'volume_name': 'volume-937ba806-7959-404d-91c4-fe98fe2be8b1', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbeefed-538e-43ef-b416-2bf5ed79daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbeefed-538e-43ef-b416-2bf5ed79daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb24ad66-4eff-403e-9db4-3c3fb7db6ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:08 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume 937ba806-7959-404d-91c4-fe98fe2be8b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-937ba806-7959-404d-91c4-fe98fe2be8b1', 'volume_size': 1} Aug 26 16:27:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:08 devstack sudo[112408]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:08 devstack sudo[112411]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 1G" returned: 0 in 0.574s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Downloaded image 6ac3a618-4ad2-4833-9626-12a425ebacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}])) to volume f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 successfully. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Temporary image 6ac3a618-4ad2-4833-9626-12a425ebacfd for user 365c8a9f6dd44464a099fd592d79fa30 is deleted. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Marking volume f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 as bootable. {{(pid=94407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6" returned: 0 in 0.416s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-2e8365d1-14e6-47c6-9675-37c1473b77e7-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.745s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1027339505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbeb2be-9be7-4d19-8524-327cb2b69f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b552f40b7044d2cacb5ab8f327e50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:08Z,use_quota=True,user_id='38710b6adaee4a95a60f4bc2ff4dd112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Creating volume adbeb2be-9be7-4d19-8524-327cb2b69f21 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:09 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-adbeb2be-9be7-4d19-8524-327cb2b69f21 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Copying metadata from image 6ac3a618-4ad2-4833-9626-12a425ebacfd to f9a27a6b-06a1-4555-a713-b1e6e72f6ee5. {{(pid=94407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Creating volume glance metadata for volume f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 backed by image 6ac3a618-4ad2-4833-9626-12a425ebacfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 16:27:09 devstack sudo[112417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-adbeb2be-9be7-4d19-8524-327cb2b69f21 1073741824 Aug 26 16:27:09 devstack sudo[112417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8546f5-c7a0-49d4-bc8f-9d0d2aacbb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f34bb20-b72c-4409-ac84-de7c74cca578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-2e8365d1-14e6-47c6-9675-37c1473b77e7-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:09 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6 (2c4fb76a-4a48-4d03-a3a2-724cda5552d6): created successfully Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f34bb20-b72c-4409-ac84-de7c74cca578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Flow 'volume_create_manager' (1ca8f801-6aa2-482a-97d3-686ba5fcd39c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ce8e0eaf-34ff-4809-8ecc-1fccd35c1cb1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Created volume successfully. Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-quobyte-2e8365d1-14e6-47c6-9675-37c1473b77e7" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-2e8365d1-14e6-47c6-9675-37c1473b77e7" acquired by "delete_volume" :: waited 0.043s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[30daa3be-f001-4b0a-be5d-9353c0b21252]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2e8365d1-14e6-47c6-9675-37c1473b77e7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Flow 'volume_create_manager' (deb24b44-1f91-45b0-9dbe-f08d85accbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74606dfc-e89e-49f9-8e22-4c55d2448e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74606dfc-e89e-49f9-8e22-4c55d2448e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1078119376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1a444d-c645-47e1-bb73-3a59d4a6c03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b552f40b7044d2cacb5ab8f327e50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:09Z,use_quota=True,user_id='38710b6adaee4a95a60f4bc2ff4dd112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46bbe32-9e91-47af-936f-0b6846ee9519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46bbe32-9e91-47af-936f-0b6846ee9519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8cb20a6-f428-4db1-9a9b-993aee5abd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8cb20a6-f428-4db1-9a9b-993aee5abd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1a444d-c645-47e1-bb73-3a59d4a6c03c', 'volume_name': 'volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8234bc-eadb-4700-8b4b-d5540de94658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:09 devstack sudo[112419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2e8365d1-14e6-47c6-9675-37c1473b77e7 Aug 26 16:27:09 devstack sudo[112419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8234bc-eadb-4700-8b4b-d5540de94658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afaf2f3-08a2-4b66-adbd-14bbe3eeac5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:09 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume dc1a444d-c645-47e1-bb73-3a59d4a6c03c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c', 'volume_size': 1} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18628c6c-3d9e-426a-b607-9bda6ea8a64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5', 'volume_size': 1, 'image_id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ac3a618-4ad2-4833-9626-12a425ebacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e462d79b2c7d44bbb01aab25a9df69a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ac3a618-4ad2-4833-9626-12a425ebacfd', 'created_at': datetime.datetime(2026, 8, 26, 14, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 6, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ac3a618-4ad2-4833-9626-12a425ebacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa56be9-fe27-4ddd-b736-765fc3654e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:09 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Volume volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 (f9a27a6b-06a1-4555-a713-b1e6e72f6ee5): created successfully Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa56be9-fe27-4ddd-b736-765fc3654e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (c7dd9055-fac2-430b-8985-2450b5508263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5db6d795-8c12-49be-859a-0acb82368c03 tempest-VolumesGetTest-454064183 None] Created volume successfully. Aug 26 16:27:09 devstack sudo[112417]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-adbeb2be-9be7-4d19-8524-327cb2b69f21 1073741824" returned: 0 in 0.689s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-adbeb2be-9be7-4d19-8524-327cb2b69f21 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:09 devstack sudo[112424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-adbeb2be-9be7-4d19-8524-327cb2b69f21 Aug 26 16:27:09 devstack sudo[112424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Flow 'volume_create_manager' (23da00b2-011f-4b9e-8e01-a5346fad4a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d322c03e-7aed-4ff0-9b96-a6753b0cacfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d322c03e-7aed-4ff0-9b96-a6753b0cacfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221046920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20edcb50-332b-4e21-8569-ae3909127b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b552f40b7044d2cacb5ab8f327e50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:10Z,use_quota=True,user_id='38710b6adaee4a95a60f4bc2ff4dd112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c79f6d6-f333-4bdc-918c-84ada4ddee43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c79f6d6-f333-4bdc-918c-84ada4ddee43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763ff61e-d70c-4a0a-accb-98b041021350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763ff61e-d70c-4a0a-accb-98b041021350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20edcb50-332b-4e21-8569-ae3909127b19', 'volume_name': 'volume-20edcb50-332b-4e21-8569-ae3909127b19', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09026db7-b549-4ce9-8a46-2ab0dc4cb986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:09 devstack sudo[112419]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09026db7-b549-4ce9-8a46-2ab0dc4cb986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c309e7-3bfa-4677-8b78-0dd2206fde78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:09 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume 20edcb50-332b-4e21-8569-ae3909127b19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20edcb50-332b-4e21-8569-ae3909127b19', 'volume_size': 1} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2e8365d1-14e6-47c6-9675-37c1473b77e7" returned: 0 in 0.609s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2e8365d1-14e6-47c6-9675-37c1473b77e7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:10 devstack sudo[112429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2e8365d1-14e6-47c6-9675-37c1473b77e7 Aug 26 16:27:10 devstack sudo[112429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:10 devstack sudo[112424]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-adbeb2be-9be7-4d19-8524-327cb2b69f21" returned: 0 in 0.350s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.263s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046023074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937ba806-7959-404d-91c4-fe98fe2be8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b552f40b7044d2cacb5ab8f327e50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:09Z,use_quota=True,user_id='38710b6adaee4a95a60f4bc2ff4dd112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Creating volume 937ba806-7959-404d-91c4-fe98fe2be8b1 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:10 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-937ba806-7959-404d-91c4-fe98fe2be8b1 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ed02e7-d0f5-4df9-8a2d-e27c0e75d74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adbeb2be-9be7-4d19-8524-327cb2b69f21', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dba2bef-c269-4881-ab81-8d89a1ddd7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:10 devstack sudo[112432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-937ba806-7959-404d-91c4-fe98fe2be8b1 1073741824 Aug 26 16:27:10 devstack sudo[112432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:10 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume volume-adbeb2be-9be7-4d19-8524-327cb2b69f21 (adbeb2be-9be7-4d19-8524-327cb2b69f21): created successfully Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dba2bef-c269-4881-ab81-8d89a1ddd7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Flow 'volume_create_manager' (bfd97b5b-258b-40d5-87ee-b79e29662bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:10 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ed98e1b6-f39c-4192-97a0-feae6dd1a4f5 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Created volume successfully. Aug 26 16:27:10 devstack sudo[112429]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2e8365d1-14e6-47c6-9675-37c1473b77e7" returned: 0 in 0.361s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-2e8365d1-14e6-47c6-9675-37c1473b77e7" released by "delete_volume" :: held 1.059s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Created reservations ['d13ecd8e-bf93-48d9-bf59-2c956b020d0a', '1517a647-8636-4f1a-9331-055dfff2ff3f', '6b16cbef-0802-4471-a8b7-e120cd2dbafe', '4b961067-9cad-4303-861e-26e559b77b61'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:10 devstack sudo[112438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:10 devstack sudo[112438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:10 devstack sudo[112432]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-937ba806-7959-404d-91c4-fe98fe2be8b1 1073741824" returned: 0 in 0.582s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-937ba806-7959-404d-91c4-fe98fe2be8b1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:10 devstack sudo[112438]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.317s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:10 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Deleted volume successfully. Aug 26 16:27:10 devstack sudo[112443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-937ba806-7959-404d-91c4-fe98fe2be8b1 Aug 26 16:27:10 devstack sudo[112443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2cfadf87-b7bb-4d2f-a3c4-97013b0ae487 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-2e8365d1-14e6-47c6-9675-37c1473b77e7-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:11 devstack sudo[112443]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-937ba806-7959-404d-91c4-fe98fe2be8b1" returned: 0 in 0.333s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.599s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1078119376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1a444d-c645-47e1-bb73-3a59d4a6c03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b552f40b7044d2cacb5ab8f327e50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:09Z,use_quota=True,user_id='38710b6adaee4a95a60f4bc2ff4dd112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Creating volume dc1a444d-c645-47e1-bb73-3a59d4a6c03c {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:11 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:11 devstack sudo[112446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c 1073741824 Aug 26 16:27:11 devstack sudo[112446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (c287e1ff-bbc0-487a-b36b-93403a584da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f80b16-2ccf-44c5-be07-9e071af087fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb24ad66-4eff-403e-9db4-3c3fb7db6ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937ba806-7959-404d-91c4-fe98fe2be8b1', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cc3b22-1931-4335-b97e-a3bd44a56106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f80b16-2ccf-44c5-be07-9e071af087fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-334940105',display_name='tempest-VolumesGetTest-Volume-1673768778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66c7ff8-49b9-4c53-9eff-fac618953c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853408d4a31a444db278c117d52838a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:11Z,use_quota=True,user_id='365c8a9f6dd44464a099fd592d79fa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c482e16-7bc6-4d47-bba0-3f35d917f6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c482e16-7bc6-4d47-bba0-3f35d917f6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48217070-a997-496b-83a2-7d75f3c00451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48217070-a997-496b-83a2-7d75f3c00451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66c7ff8-49b9-4c53-9eff-fac618953c23', 'volume_name': 'volume-d66c7ff8-49b9-4c53-9eff-fac618953c23', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8408b8-abbd-4673-b7bf-c6a741a3c1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8408b8-abbd-4673-b7bf-c6a741a3c1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02177442-beae-495c-956b-1cb3829d66d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:11 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Volume d66c7ff8-49b9-4c53-9eff-fac618953c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66c7ff8-49b9-4c53-9eff-fac618953c23', 'volume_size': 1} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:11 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume volume-937ba806-7959-404d-91c4-fe98fe2be8b1 (937ba806-7959-404d-91c4-fe98fe2be8b1): created successfully Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cc3b22-1931-4335-b97e-a3bd44a56106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Flow 'volume_create_manager' (7f872488-367b-4b25-8f8f-a75a9f106f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-5e53d795-a528-4e8d-958a-49e0f999eb1f-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:11 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c5c10ccf-858c-4d2b-89c8-b9971a2a1fa1 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Created volume successfully. Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-5e53d795-a528-4e8d-958a-49e0f999eb1f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-quobyte-5e53d795-a528-4e8d-958a-49e0f999eb1f" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-5e53d795-a528-4e8d-958a-49e0f999eb1f" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b5a1ed-930c-4b7b-9fd0-4fa31a3ffaac]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5e53d795-a528-4e8d-958a-49e0f999eb1f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:11 devstack sudo[112451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5e53d795-a528-4e8d-958a-49e0f999eb1f Aug 26 16:27:11 devstack sudo[112451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:11 devstack sudo[112446]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c 1073741824" returned: 0 in 0.494s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:11 devstack sudo[112455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c Aug 26 16:27:11 devstack sudo[112455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:11 devstack sudo[112451]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5e53d795-a528-4e8d-958a-49e0f999eb1f" returned: 0 in 0.437s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5e53d795-a528-4e8d-958a-49e0f999eb1f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:11 devstack sudo[112460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5e53d795-a528-4e8d-958a-49e0f999eb1f Aug 26 16:27:11 devstack sudo[112460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:11 devstack sudo[112455]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c" returned: 0 in 0.283s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.024s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221046920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20edcb50-332b-4e21-8569-ae3909127b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b552f40b7044d2cacb5ab8f327e50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:10Z,use_quota=True,user_id='38710b6adaee4a95a60f4bc2ff4dd112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Creating volume 20edcb50-332b-4e21-8569-ae3909127b19 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:12 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20edcb50-332b-4e21-8569-ae3909127b19 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afaf2f3-08a2-4b66-adbd-14bbe3eeac5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008a57b4-6621-4920-9c15-c7c5f25a7355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:12 devstack sudo[112463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20edcb50-332b-4e21-8569-ae3909127b19 1073741824 Aug 26 16:27:12 devstack sudo[112463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:12 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c (dc1a444d-c645-47e1-bb73-3a59d4a6c03c): created successfully Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008a57b4-6621-4920-9c15-c7c5f25a7355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Flow 'volume_create_manager' (deb24b44-1f91-45b0-9dbe-f08d85accbbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:12 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-28da5564-88d7-4ebb-be3e-fead90222cbc tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Created volume successfully. Aug 26 16:27:12 devstack sudo[112460]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5e53d795-a528-4e8d-958a-49e0f999eb1f" returned: 0 in 0.330s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-5e53d795-a528-4e8d-958a-49e0f999eb1f" released by "delete_volume" :: held 0.813s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Created reservations ['896d2354-f256-4e3d-a9d5-699841d71ffc', '02a8a723-6377-4a61-9a8e-5f9c3bb261ed', 'e4102ca6-bf52-442d-9be2-687c7abef574', 'd3738bb0-d4db-4e0e-a634-922c5fee5109'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:12 devstack sudo[112469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:12 devstack sudo[112469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-4f025b18-a7af-4e47-a636-f9325e79c990-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-4f025b18-a7af-4e47-a636-f9325e79c990-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-quobyte-1b00f47e-1e3e-41ab-9be9-f83754694bcb" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-1b00f47e-1e3e-41ab-9be9-f83754694bcb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-quobyte-4f025b18-a7af-4e47-a636-f9325e79c990" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-4f025b18-a7af-4e47-a636-f9325e79c990" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Deleting offline snapshot 4f025b18-a7af-4e47-a636-f9325e79c990 of volume 1b00f47e-1e3e-41ab-9be9-f83754694bcb {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] snapshot_file for this snap is: volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f38ed5d-7b59-42b8-99d6-4ea96afc836c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:12 devstack sudo[112463]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:12 devstack sudo[112469]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20edcb50-332b-4e21-8569-ae3909127b19 1073741824" returned: 0 in 0.701s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.331s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:12 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Deleted volume successfully. Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20edcb50-332b-4e21-8569-ae3909127b19 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2d9ac060-2d58-4afa-88b9-8dd5d10caf35 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-5e53d795-a528-4e8d-958a-49e0f999eb1f-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:12 devstack sudo[112473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 Aug 26 16:27:12 devstack sudo[112474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20edcb50-332b-4e21-8569-ae3909127b19 Aug 26 16:27:12 devstack sudo[112473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:12 devstack sudo[112474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:13 devstack sudo[112474]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20edcb50-332b-4e21-8569-ae3909127b19" returned: 0 in 0.271s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-334940105',display_name='tempest-VolumesGetTest-Volume-1673768778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66c7ff8-49b9-4c53-9eff-fac618953c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853408d4a31a444db278c117d52838a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:11Z,use_quota=True,user_id='365c8a9f6dd44464a099fd592d79fa30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Creating volume d66c7ff8-49b9-4c53-9eff-fac618953c23 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:13 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d66c7ff8-49b9-4c53-9eff-fac618953c23 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:13 devstack sudo[112473]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990" returned: 0 in 0.424s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:27:13 devstack sudo[112481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d66c7ff8-49b9-4c53-9eff-fac618953c23 1073741824 Aug 26 16:27:13 devstack sudo[112481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c309e7-3bfa-4677-8b78-0dd2206fde78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20edcb50-332b-4e21-8569-ae3909127b19', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cf4fd7-eace-49ff-8718-e3782867edd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afa26df-cfb0-46e4-ad37-ef2778e2b830]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:13 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Volume volume-20edcb50-332b-4e21-8569-ae3909127b19 (20edcb50-332b-4e21-8569-ae3909127b19): created successfully Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cf4fd7-eace-49ff-8718-e3782867edd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Flow 'volume_create_manager' (23da00b2-011f-4b9e-8e01-a5346fad4a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0c0d5d75-79e1-450d-82e0-3540532c3dde tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Created volume successfully. Aug 26 16:27:13 devstack sudo[112483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb Aug 26 16:27:13 devstack sudo[112483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "cinder-20edcb50-332b-4e21-8569-ae3909127b19-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-20edcb50-332b-4e21-8569-ae3909127b19-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "cinder-quobyte-20edcb50-332b-4e21-8569-ae3909127b19" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-quobyte-20edcb50-332b-4e21-8569-ae3909127b19" acquired by "delete_volume" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1620eb05-1f56-4025-bfaf-6c0d20ce8ae7]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20edcb50-332b-4e21-8569-ae3909127b19 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:13 devstack sudo[112483]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb" returned: 0 in 0.477s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:13 devstack sudo[112494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 Aug 26 16:27:13 devstack sudo[112494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:13 devstack sudo[112481]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d66c7ff8-49b9-4c53-9eff-fac618953c23 1073741824" returned: 0 in 0.596s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:13 devstack sudo[112493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20edcb50-332b-4e21-8569-ae3909127b19 Aug 26 16:27:13 devstack sudo[112493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d66c7ff8-49b9-4c53-9eff-fac618953c23 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:13 devstack sudo[112497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d66c7ff8-49b9-4c53-9eff-fac618953c23 Aug 26 16:27:13 devstack sudo[112497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:13 devstack sudo[112493]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20edcb50-332b-4e21-8569-ae3909127b19" returned: 0 in 0.414s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20edcb50-332b-4e21-8569-ae3909127b19 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:13 devstack sudo[112497]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d66c7ff8-49b9-4c53-9eff-fac618953c23" returned: 0 in 0.295s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:13 devstack sudo[112507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20edcb50-332b-4e21-8569-ae3909127b19 Aug 26 16:27:13 devstack sudo[112507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02177442-beae-495c-956b-1cb3829d66d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66c7ff8-49b9-4c53-9eff-fac618953c23', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde2130d-0a9d-42dc-8fb6-bd5c59029151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:14 devstack sudo[112494]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990" returned: 0 in 0.436s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:14 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Volume volume-d66c7ff8-49b9-4c53-9eff-fac618953c23 (d66c7ff8-49b9-4c53-9eff-fac618953c23): created successfully Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde2130d-0a9d-42dc-8fb6-bd5c59029151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Flow 'volume_create_manager' (c287e1ff-bbc0-487a-b36b-93403a584da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:14 devstack sudo[112509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990 Aug 26 16:27:14 devstack sudo[112509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:14 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5e417514-f2dd-406c-bb85-cbbbf33bc2f1 tempest-VolumesGetTest-454064183 None] Created volume successfully. Aug 26 16:27:14 devstack sudo[112507]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-20edcb50-332b-4e21-8569-ae3909127b19" returned: 0 in 0.346s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-quobyte-20edcb50-332b-4e21-8569-ae3909127b19" released by "delete_volume" :: held 0.822s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:14 devstack sudo[112509]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb.4f025b18-a7af-4e47-a636-f9325e79c990" returned: 0 in 0.315s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-4f025b18-a7af-4e47-a636-f9325e79c990" released by "_delete_snapshot" :: held 1.812s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-1b00f47e-1e3e-41ab-9be9-f83754694bcb" released by "delete_snapshot" :: held 1.843s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Created reservations ['576c0ed8-17da-4ed9-8c1d-df6f7427f94e', 'c0aa8035-5166-4294-9e01-e7a359be7104', '5e1e400a-b5cd-45ce-be6f-609a71da5d6f', '8dd6fd99-16ec-4610-9ec6-eaa2e0c32206'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Created reservations ['d783e3ee-ac85-4deb-82ba-d14aaa431092', '009621a6-10de-4633-a967-c9a4ac6d767d', '12dadca3-fbcf-4f16-90a9-6d4ce3cc5695', '4a21e61a-e8d3-4ba2-aa27-4d173898c026'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-d66c7ff8-49b9-4c53-9eff-fac618953c23-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Lock "cinder-d66c7ff8-49b9-4c53-9eff-fac618953c23-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:14 devstack sudo[112514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:14 devstack sudo[112514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "cinder-dc1a444d-c645-47e1-bb73-3a59d4a6c03c-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-1b00f47e-1e3e-41ab-9be9-f83754694bcb-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-quobyte-d66c7ff8-49b9-4c53-9eff-fac618953c23" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-dc1a444d-c645-47e1-bb73-3a59d4a6c03c-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:14 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Delete snapshot completed successfully. Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-d66c7ff8-49b9-4c53-9eff-fac618953c23" acquired by "delete_volume" :: waited 0.067s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-1b00f47e-1e3e-41ab-9be9-f83754694bcb-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-183c36a7-f739-4d61-be86-ab0d3fbce7a1 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-4f025b18-a7af-4e47-a636-f9325e79c990-delete_snapshot" released by "delete_snapshot" :: held 2.275s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[62517e6a-de1e-4e9c-a4e2-7deb9e72fe53]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d66c7ff8-49b9-4c53-9eff-fac618953c23 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "cinder-quobyte-dc1a444d-c645-47e1-bb73-3a59d4a6c03c" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "cinder-quobyte-1b00f47e-1e3e-41ab-9be9-f83754694bcb" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-quobyte-dc1a444d-c645-47e1-bb73-3a59d4a6c03c" acquired by "delete_volume" :: waited 0.050s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:14 devstack sudo[112514]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-1b00f47e-1e3e-41ab-9be9-f83754694bcb" acquired by "delete_volume" :: waited 0.055s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.396s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[921632bf-3a0e-44eb-9774-690d65737cd5]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6932fc-4923-476a-b584-f0d5e258b3c9]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:15 devstack sudo[112516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d66c7ff8-49b9-4c53-9eff-fac618953c23 Aug 26 16:27:15 devstack sudo[112516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:15 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Deleted volume successfully. Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1252aafe-90a6-4b96-9aa0-96e3a084614d tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-20edcb50-332b-4e21-8569-ae3909127b19-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:15 devstack sudo[112518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c Aug 26 16:27:15 devstack sudo[112518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:15 devstack sudo[112520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb Aug 26 16:27:15 devstack sudo[112520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:15 devstack sudo[112516]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d66c7ff8-49b9-4c53-9eff-fac618953c23" returned: 0 in 0.508s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d66c7ff8-49b9-4c53-9eff-fac618953c23 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:15 devstack sudo[112529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d66c7ff8-49b9-4c53-9eff-fac618953c23 Aug 26 16:27:15 devstack sudo[112529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:15 devstack sudo[112518]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c" returned: 0 in 0.418s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:15 devstack sudo[112534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c Aug 26 16:27:15 devstack sudo[112534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:15 devstack sudo[112520]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb" returned: 0 in 0.444s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:15 devstack sudo[112536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb Aug 26 16:27:15 devstack sudo[112536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:15 devstack sudo[112529]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d66c7ff8-49b9-4c53-9eff-fac618953c23" returned: 0 in 0.323s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-d66c7ff8-49b9-4c53-9eff-fac618953c23" released by "delete_volume" :: held 0.900s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:15 devstack sudo[112534]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-dc1a444d-c645-47e1-bb73-3a59d4a6c03c" returned: 0 in 0.288s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-quobyte-dc1a444d-c645-47e1-bb73-3a59d4a6c03c" released by "delete_volume" :: held 0.805s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:15 devstack sudo[112536]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-1b00f47e-1e3e-41ab-9be9-f83754694bcb" returned: 0 in 0.319s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Created reservations ['14324fd7-76b4-4cd6-9efa-8fec5ce3defb', 'ec35ad4d-a61d-4d52-bf6f-62b1e7fd0d70', '64caca8f-31b1-4715-a693-0acdfbe61db6', 'e8811fea-09b3-4f7c-8974-d9a7613bd2ff'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-quobyte-1b00f47e-1e3e-41ab-9be9-f83754694bcb" released by "delete_volume" :: held 0.858s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Created reservations ['35032e87-3de1-47a9-8639-a55729667723', '94c35103-36a8-4790-8475-420e7a5fb4b1', '5e0fe488-9c08-4ee8-8f1e-5a5d0ca19179', '28f49d90-bc26-4f41-a883-ed4d6a0a5654'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Created reservations ['4f0aa42c-b9fb-4bf5-954e-53ba9836884f', '62255e3d-5115-4f87-9871-4013a7691e7f', '8b438dca-fe9d-4e1f-9f43-67e899ab3a63', 'd2becbe7-5e04-47e4-89fd-e22a21fee7a9'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:15 devstack sudo[112541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:15 devstack sudo[112541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:16 devstack sudo[112543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:16 devstack sudo[112543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:16 devstack sudo[112545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:16 devstack sudo[112545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:16 devstack sudo[112541]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.298s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Deleted volume successfully. Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6065ce73-0438-45cc-a156-c8baa12316c8 tempest-VolumesGetTest-454064183 None] Lock "cinder-d66c7ff8-49b9-4c53-9eff-fac618953c23-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:16 devstack sudo[112543]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.301s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Deleted volume successfully. Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-237ed89e-1bac-4997-8bd3-ae0ab38a2c1b tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-dc1a444d-c645-47e1-bb73-3a59d4a6c03c-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:16 devstack sudo[112545]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.301s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Deleted volume successfully. Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f41d7a50-a3f6-4913-9186-ff7a15e7e394 tempest-CreateVolumesFromSnapshotTest-1144838476 None] Lock "cinder-1b00f47e-1e3e-41ab-9be9-f83754694bcb-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Lock "cinder-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Acquiring lock "cinder-quobyte-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5" acquired by "delete_volume" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e445cb83-619e-4118-9a5c-9e28f927b409]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "cinder-937ba806-7959-404d-91c4-fe98fe2be8b1-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-937ba806-7959-404d-91c4-fe98fe2be8b1-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:17 devstack sudo[112550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 Aug 26 16:27:17 devstack sudo[112550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "cinder-quobyte-937ba806-7959-404d-91c4-fe98fe2be8b1" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-quobyte-937ba806-7959-404d-91c4-fe98fe2be8b1" acquired by "delete_volume" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[686e07fd-7c1d-4bee-8946-b7adebfec917]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-937ba806-7959-404d-91c4-fe98fe2be8b1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:17 devstack sudo[112552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-937ba806-7959-404d-91c4-fe98fe2be8b1 Aug 26 16:27:17 devstack sudo[112552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:17 devstack sudo[112550]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5" returned: 0 in 0.480s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:17 devstack sudo[112557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5 Aug 26 16:27:17 devstack sudo[112557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:17 devstack sudo[112552]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-937ba806-7959-404d-91c4-fe98fe2be8b1" returned: 0 in 0.460s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-937ba806-7959-404d-91c4-fe98fe2be8b1 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:17 devstack sudo[112562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-937ba806-7959-404d-91c4-fe98fe2be8b1 Aug 26 16:27:17 devstack sudo[112562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:17 devstack sudo[112557]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5" returned: 0 in 0.357s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Lock "cinder-quobyte-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5" released by "delete_volume" :: held 0.909s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Created reservations ['9c0a8885-de5d-4f60-86aa-8764a8d09700', 'f6f547be-0f80-4afe-ad26-7aa9c28336c7', 'a9162b2c-d033-4ee2-8bbd-931f0474a117', '83d2975e-f44c-4a75-b75d-ee79d4d886a5'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:18 devstack sudo[112565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:18 devstack sudo[112565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:18 devstack sudo[112562]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-937ba806-7959-404d-91c4-fe98fe2be8b1" returned: 0 in 0.468s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:18 devstack sudo[112568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-quobyte-937ba806-7959-404d-91c4-fe98fe2be8b1" released by "delete_volume" :: held 0.992s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:18 devstack sudo[112568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Created reservations ['23bc85cc-c850-47b3-b912-31ae8bf28cf5', '8e55de39-5307-4081-b725-d51675241181', '7534a614-8175-4ca4-b9f3-0e14cfefa120', 'fca08a8a-ed0b-43c2-8975-19682273e7cc'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:18 devstack sudo[112570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:18 devstack sudo[112570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:18 devstack sudo[112568]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:18 devstack sudo[112565]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.454s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.326s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 28 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:27:18 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Deleted volume successfully. Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6b9b8d5d-5200-4369-b2a8-1f23338254ed tempest-VolumesGetTest-454064183 None] Lock "cinder-f9a27a6b-06a1-4555-a713-b1e6e72f6ee5-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:18 devstack sudo[112570]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.335s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:18 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Deleted volume successfully. Aug 26 16:27:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-28712d47-e049-4d3c-b0c7-e6f7683a9b9c tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-937ba806-7959-404d-91c4-fe98fe2be8b1-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "cinder-adbeb2be-9be7-4d19-8524-327cb2b69f21-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-adbeb2be-9be7-4d19-8524-327cb2b69f21-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "cinder-quobyte-adbeb2be-9be7-4d19-8524-327cb2b69f21" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-quobyte-adbeb2be-9be7-4d19-8524-327cb2b69f21" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:19 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daf798e-fd11-4100-9281-76b38b75dc40]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-adbeb2be-9be7-4d19-8524-327cb2b69f21 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:19 devstack sudo[112575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-adbeb2be-9be7-4d19-8524-327cb2b69f21 Aug 26 16:27:19 devstack sudo[112575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:19 devstack sudo[112575]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-adbeb2be-9be7-4d19-8524-327cb2b69f21" returned: 0 in 0.387s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-adbeb2be-9be7-4d19-8524-327cb2b69f21 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:19 devstack sudo[112580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-adbeb2be-9be7-4d19-8524-327cb2b69f21 Aug 26 16:27:19 devstack sudo[112580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:20 devstack sudo[112580]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-adbeb2be-9be7-4d19-8524-327cb2b69f21" returned: 0 in 0.360s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-quobyte-adbeb2be-9be7-4d19-8524-327cb2b69f21" released by "delete_volume" :: held 0.809s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Created reservations ['e182803a-e7cb-46c6-965e-7f54699bd04a', '629dfd61-ad76-4074-989c-02ecbe518531', '083ce621-2935-4f7d-962f-31d54e41813e', '6e279bc7-158a-421b-adb6-ff19937f7ea8'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:20 devstack sudo[112584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:20 devstack sudo[112584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "cinder-2c4fb76a-4a48-4d03-a3a2-724cda5552d6-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-2c4fb76a-4a48-4d03-a3a2-724cda5552d6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "cinder-quobyte-2c4fb76a-4a48-4d03-a3a2-724cda5552d6" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-quobyte-2c4fb76a-4a48-4d03-a3a2-724cda5552d6" acquired by "delete_volume" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a0ed98-2e60-484e-aa84-8abaa3dd180e]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:20 devstack sudo[112584]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.314s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:20 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Deleted volume successfully. Aug 26 16:27:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-53693202-361f-481d-9104-46f448fbe3cf tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-adbeb2be-9be7-4d19-8524-327cb2b69f21-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:21 devstack sudo[112587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6 Aug 26 16:27:21 devstack sudo[112587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:21 devstack sudo[112587]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6" returned: 0 in 0.460s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:21 devstack sudo[112592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6 Aug 26 16:27:21 devstack sudo[112592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:21 devstack sudo[112592]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2c4fb76a-4a48-4d03-a3a2-724cda5552d6" returned: 0 in 0.259s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-quobyte-2c4fb76a-4a48-4d03-a3a2-724cda5552d6" released by "delete_volume" :: held 0.786s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:21 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Created reservations ['86e02216-a5f0-4c97-ba62-f22adb8e7a43', '4b019fd4-09fa-466d-9e83-217c4a51890f', '7dba4543-565a-40c4-be08-e46db4be80ad', '16ac7eb9-8914-4e3c-941d-1b747fac30ad'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:21 devstack sudo[112595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:21 devstack sudo[112595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "cinder-01d2d659-ab9f-4a70-8669-eccf6ac3e58d-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-01d2d659-ab9f-4a70-8669-eccf6ac3e58d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "cinder-quobyte-01d2d659-ab9f-4a70-8669-eccf6ac3e58d" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-quobyte-01d2d659-ab9f-4a70-8669-eccf6ac3e58d" acquired by "delete_volume" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:22 devstack sudo[112595]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.355s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:22 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Deleted volume successfully. Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b89e6a-315f-4cce-9c6f-ab3930bee8d7]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-427245c7-aa9d-4a2c-9415-78790e8266bd tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-2c4fb76a-4a48-4d03-a3a2-724cda5552d6-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:22 devstack sudo[112598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d Aug 26 16:27:22 devstack sudo[112598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:22 devstack sudo[112598]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d" returned: 0 in 0.410s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:22 devstack sudo[112603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d Aug 26 16:27:22 devstack sudo[112603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:22 devstack sudo[112603]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-01d2d659-ab9f-4a70-8669-eccf6ac3e58d" returned: 0 in 0.292s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-quobyte-01d2d659-ab9f-4a70-8669-eccf6ac3e58d" released by "delete_volume" :: held 0.763s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Created reservations ['ca7ed200-e5ee-42af-b0c7-6cc51ae055c8', '5e66a33b-2629-4f9b-b69f-ee030ce4c0e2', '40326475-3ff9-4e28-8f0d-bd5054f18be3', 'c6a34b89-24f9-4077-965a-cd2e3f42d18c'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:23 devstack sudo[112606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:23 devstack sudo[112606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:23 devstack sudo[112606]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.317s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:23 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Deleted volume successfully. Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0b3b05a5-4c11-4d36-bee4-fb58540f98a7 tempest-CreateVolumesFromSourceVolumeTest-723953419 None] Lock "cinder-01d2d659-ab9f-4a70-8669-eccf6ac3e58d-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Flow 'volume_create_manager' (1fd02cd8-0956-43f3-adcd-cf6c0c79de60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bd2b4f-beaf-4407-a6e7-35ae7fb6bbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bd2b4f-beaf-4407-a6e7-35ae7fb6bbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-472866432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0eadd80-1e53-49c4-b6c2-2d85d124cd20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df53614a34f4f97b15b678ca7e6bf52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:24Z,use_quota=True,user_id='02d17f41c00147a589aed32fc410b267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a6a223-2fac-4e32-943b-c1b9ff2e98f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a6a223-2fac-4e32-943b-c1b9ff2e98f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9186225b-66b7-43bc-a8a5-06cf00b04a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9186225b-66b7-43bc-a8a5-06cf00b04a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0eadd80-1e53-49c4-b6c2-2d85d124cd20', 'volume_name': 'volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258964a7-2916-42da-a413-177370171023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258964a7-2916-42da-a413-177370171023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdf89f3-9720-43fe-aed5-0b5dc591f7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:23 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Volume c0eadd80-1e53-49c4-b6c2-2d85d124cd20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20', 'volume_size': 1} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-472866432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0eadd80-1e53-49c4-b6c2-2d85d124cd20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df53614a34f4f97b15b678ca7e6bf52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:24Z,use_quota=True,user_id='02d17f41c00147a589aed32fc410b267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Creating volume c0eadd80-1e53-49c4-b6c2-2d85d124cd20 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:23 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:23 devstack sudo[112609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20 1073741824 Aug 26 16:27:23 devstack sudo[112609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:24 devstack sudo[112609]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20 1073741824" returned: 0 in 0.547s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:24 devstack sudo[112615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20 Aug 26 16:27:24 devstack sudo[112615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:24 devstack sudo[112615]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20" returned: 0 in 0.330s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdf89f3-9720-43fe-aed5-0b5dc591f7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612e7f6b-8442-48e1-8841-66bd979d9177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:24 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Volume volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20 (c0eadd80-1e53-49c4-b6c2-2d85d124cd20): created successfully Aug 26 16:27:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612e7f6b-8442-48e1-8841-66bd979d9177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Flow 'volume_create_manager' (1fd02cd8-0956-43f3-adcd-cf6c0c79de60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:24 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ea43bbe7-9fa6-45fe-ac0c-18668bb99e50 tempest-VolumesNegativeTest-921237223 None] Created volume successfully. Aug 26 16:27:24 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Flow 'volume_create_manager' (7e7569f2-09f0-441a-8ef0-2b6e490430a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc4c133-3c51-4b4e-94ab-4e585a96c803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc4c133-3c51-4b4e-94ab-4e585a96c803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022316412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3342b406-ed02-4aad-b02e-4828f9e73b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d6cc69827d420ba0e384aff3834468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:25Z,use_quota=True,user_id='81595c00860b427c9d16ff657521d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d54bc5-bf70-40a4-bc8f-f3afaf69c040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d54bc5-bf70-40a4-bc8f-f3afaf69c040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd37b1b7-9de7-4640-a19f-e4498907f46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd37b1b7-9de7-4640-a19f-e4498907f46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3342b406-ed02-4aad-b02e-4828f9e73b58', 'volume_name': 'volume-3342b406-ed02-4aad-b02e-4828f9e73b58', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fba9dc-65da-4409-9c71-9a4c08bfac9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fba9dc-65da-4409-9c71-9a4c08bfac9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b1fd63-eddb-491b-93f7-7af78da45e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:25 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Volume 3342b406-ed02-4aad-b02e-4828f9e73b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3342b406-ed02-4aad-b02e-4828f9e73b58', 'volume_size': 1} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022316412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3342b406-ed02-4aad-b02e-4828f9e73b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d6cc69827d420ba0e384aff3834468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:25Z,use_quota=True,user_id='81595c00860b427c9d16ff657521d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Creating volume 3342b406-ed02-4aad-b02e-4828f9e73b58 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:25 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3342b406-ed02-4aad-b02e-4828f9e73b58 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:25 devstack sudo[112619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3342b406-ed02-4aad-b02e-4828f9e73b58 1073741824 Aug 26 16:27:25 devstack sudo[112619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Flow 'volume_create_manager' (d4b653de-19de-49de-bae9-76b19a7b8585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4270441b-6f5e-4e77-9f58-072732302a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4270441b-6f5e-4e77-9f58-072732302a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4188891-4bc5-490c-95e8-6e38345ce756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6d266b8ea947e6bd3026794bc58db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:25Z,use_quota=True,user_id='fcc1844cc87e47ae9454f43547ee283f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f52f163-138d-4bf9-bd30-36b84d4da07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f52f163-138d-4bf9-bd30-36b84d4da07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86509035-1687-4f8c-a118-fd156f48e488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.image.glance [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Creating Keystone auth plugin from conf {{(pid=94407) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 16:27:25 devstack sudo[112619]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86509035-1687-4f8c-a118-fd156f48e488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4188891-4bc5-490c-95e8-6e38345ce756', 'volume_name': 'volume-c4188891-4bc5-490c-95e8-6e38345ce756', 'volume_size': 1, 'image_id': '21bb2363-9763-4bcf-b3f2-e61ee3a47638', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21bb2363-9763-4bcf-b3f2-e61ee3a47638', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6cab1620e81204cbb7ad3919d1aaaf75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca6d266b8ea947e6bd3026794bc58db5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3b1896df8270c02214b9a545bde407822e564ebb4242596328ce770b9b90a185465543c51884039ca4353e12d686e9c92fd53311cde12817be490a7ba0103e50', 'id': '21bb2363-9763-4bcf-b3f2-e61ee3a47638', 'created_at': datetime.datetime(2026, 8, 26, 14, 27, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 27, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21bb2363-9763-4bcf-b3f2-e61ee3a47638/file', 'properties': {}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da94cd23-d151-4d5f-8f95-7c91cc6d4655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da94cd23-d151-4d5f-8f95-7c91cc6d4655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fe1a19-1463-47ad-8b2e-dd390229132f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:25 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Volume c4188891-4bc5-490c-95e8-6e38345ce756: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4188891-4bc5-490c-95e8-6e38345ce756', 'volume_size': 1, 'image_id': '21bb2363-9763-4bcf-b3f2-e61ee3a47638', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21bb2363-9763-4bcf-b3f2-e61ee3a47638', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6cab1620e81204cbb7ad3919d1aaaf75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca6d266b8ea947e6bd3026794bc58db5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3b1896df8270c02214b9a545bde407822e564ebb4242596328ce770b9b90a185465543c51884039ca4353e12d686e9c92fd53311cde12817be490a7ba0103e50', 'id': '21bb2363-9763-4bcf-b3f2-e61ee3a47638', 'created_at': datetime.datetime(2026, 8, 26, 14, 27, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 27, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21bb2363-9763-4bcf-b3f2-e61ee3a47638/file', 'properties': {}}, 'image_service': } Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Trying to clone c4188891-4bc5-490c-95e8-6e38345ce756 from image 21bb2363-9763-4bcf-b3f2-e61ee3a47638 at location (None, [{'url': 'file:///opt/stack/data/glance/images/21bb2363-9763-4bcf-b3f2-e61ee3a47638', 'metadata': {}}]). {{(pid=94407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3342b406-ed02-4aad-b02e-4828f9e73b58 1073741824" returned: 0 in 0.511s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3342b406-ed02-4aad-b02e-4828f9e73b58 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:25 devstack sudo[112624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3342b406-ed02-4aad-b02e-4828f9e73b58 Aug 26 16:27:25 devstack sudo[112624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 16:27:25 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Image download 0.00 MB at 0.00 MB/s Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f094416-5f95-4413-a09b-9b9d22d57bd8]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:25 devstack sudo[112626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD Aug 26 16:27:25 devstack sudo[112626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:25 devstack sudo[112624]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3342b406-ed02-4aad-b02e-4828f9e73b58" returned: 0 in 0.301s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b1fd63-eddb-491b-93f7-7af78da45e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3342b406-ed02-4aad-b02e-4828f9e73b58', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c10630-dac0-429f-acde-2635701e8fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:26 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Volume volume-3342b406-ed02-4aad-b02e-4828f9e73b58 (3342b406-ed02-4aad-b02e-4828f9e73b58): created successfully Aug 26 16:27:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c10630-dac0-429f-acde-2635701e8fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:26 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Flow 'volume_create_manager' (7e7569f2-09f0-441a-8ef0-2b6e490430a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:26 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ebb0ec60-9483-4332-ba62-076093c5ade6 tempest-ProjectReaderTests-519087225 None] Created volume successfully. Aug 26 16:27:26 devstack sudo[112626]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:26 devstack sudo[112631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD Aug 26 16:27:26 devstack sudo[112631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:26 devstack sudo[112631]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD" returned: 1 in 0.324s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:27:26 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Temporary image 21bb2363-9763-4bcf-b3f2-e61ee3a47638 is fetched for user fcc1844cc87e47ae9454f43547ee283f. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 16:27:26 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a9f2a0-5e8b-47bf-a03a-ceac4c28ba90]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:26 devstack sudo[112639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD Aug 26 16:27:26 devstack sudo[112639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:26 devstack sudo[112639]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:27 devstack sudo[112643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD Aug 26 16:27:27 devstack sudo[112643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Acquiring lock "cinder-3342b406-ed02-4aad-b02e-4828f9e73b58-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Lock "cinder-3342b406-ed02-4aad-b02e-4828f9e73b58-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Acquiring lock "cinder-quobyte-3342b406-ed02-4aad-b02e-4828f9e73b58" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:27 devstack sudo[112643]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4188891-4bc5-490c-95e8-6e38345ce756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6d266b8ea947e6bd3026794bc58db5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:25Z,use_quota=True,user_id='fcc1844cc87e47ae9454f43547ee283f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Creating volume c4188891-4bc5-490c-95e8-6e38345ce756 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:27 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Lock "cinder-quobyte-3342b406-ed02-4aad-b02e-4828f9e73b58" acquired by "delete_volume" :: waited 0.037s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:27 devstack sudo[112648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 1073741824 Aug 26 16:27:27 devstack sudo[112648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacabd80-4cdc-4d9e-b93f-9e6c05d5a85f]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3342b406-ed02-4aad-b02e-4828f9e73b58 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:27 devstack sudo[112650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3342b406-ed02-4aad-b02e-4828f9e73b58 Aug 26 16:27:27 devstack sudo[112650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:27 devstack sudo[112650]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3342b406-ed02-4aad-b02e-4828f9e73b58" returned: 0 in 0.407s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3342b406-ed02-4aad-b02e-4828f9e73b58 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:27 devstack sudo[112659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3342b406-ed02-4aad-b02e-4828f9e73b58 Aug 26 16:27:27 devstack sudo[112659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:27 devstack sudo[112648]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 1073741824" returned: 0 in 0.494s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:27 devstack sudo[112661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 Aug 26 16:27:27 devstack sudo[112661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:28 devstack sudo[112659]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3342b406-ed02-4aad-b02e-4828f9e73b58" returned: 0 in 0.304s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Lock "cinder-quobyte-3342b406-ed02-4aad-b02e-4828f9e73b58" released by "delete_volume" :: held 0.762s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Created reservations ['21ac0cf8-0d15-4f01-a44b-3e125d199de6', '82909cbb-d4a4-41b0-848b-283b986d032c', 'a1ba0252-9e64-4c5e-b076-b144e1d28009', 'e317ed43-5379-42f3-8682-72a61be4d01f'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:28 devstack sudo[112661]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756" returned: 0 in 0.360s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Attempting download of 21bb2363-9763-4bcf-b3f2-e61ee3a47638 ((None, [{'url': 'file:///opt/stack/data/glance/images/21bb2363-9763-4bcf-b3f2-e61ee3a47638', 'metadata': {}}])) to volume c4188891-4bc5-490c-95e8-6e38345ce756. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 16:27:28 devstack sudo[112665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:28 devstack sudo[112665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1475802a-80b0-41e9-9c92-cb9233d0aa7f]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21bb2363-9763-4bcf-b3f2-e61ee3a47638__8imif0i {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:28 devstack sudo[112668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21bb2363-9763-4bcf-b3f2-e61ee3a47638__8imif0i Aug 26 16:27:28 devstack sudo[112668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:28 devstack sudo[112665]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.388s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:28 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Deleted volume successfully. Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0a5e67ae-ce47-462d-932f-bc19a5f231d6 tempest-ProjectReaderTests-519087225 None] Lock "cinder-3342b406-ed02-4aad-b02e-4828f9e73b58-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:28 devstack sudo[112668]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21bb2363-9763-4bcf-b3f2-e61ee3a47638__8imif0i" returned: 0 in 0.566s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21bb2363-9763-4bcf-b3f2-e61ee3a47638__8imif0i {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:29 devstack sudo[112717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21bb2363-9763-4bcf-b3f2-e61ee3a47638__8imif0i Aug 26 16:27:29 devstack sudo[112717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Flow 'volume_create_manager' (5533c5c3-0e43-4845-a656-a4d4461c499a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a43d3e5-b6a5-47ea-ae3a-a05daa8e90ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a43d3e5-b6a5-47ea-ae3a-a05daa8e90ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1932942215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75296fd-6157-4b2a-b3cb-af811239cf77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d6cc69827d420ba0e384aff3834468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:29Z,use_quota=True,user_id='81595c00860b427c9d16ff657521d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0b7c9d-ed42-4ae6-a901-4a1d1b70bfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0b7c9d-ed42-4ae6-a901-4a1d1b70bfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e7a717-7f2d-41ff-9e27-003eebfb5a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e7a717-7f2d-41ff-9e27-003eebfb5a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a75296fd-6157-4b2a-b3cb-af811239cf77', 'volume_name': 'volume-a75296fd-6157-4b2a-b3cb-af811239cf77', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a29d0d1-7be2-4e7b-a439-f7c7dfb78406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a29d0d1-7be2-4e7b-a439-f7c7dfb78406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bc9939-00e7-4cb8-abe3-d5d241ee225c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:29 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Volume a75296fd-6157-4b2a-b3cb-af811239cf77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a75296fd-6157-4b2a-b3cb-af811239cf77', 'volume_size': 1} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1932942215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75296fd-6157-4b2a-b3cb-af811239cf77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d6cc69827d420ba0e384aff3834468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:29Z,use_quota=True,user_id='81595c00860b427c9d16ff657521d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Creating volume a75296fd-6157-4b2a-b3cb-af811239cf77 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:29 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a75296fd-6157-4b2a-b3cb-af811239cf77 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:29 devstack sudo[112727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a75296fd-6157-4b2a-b3cb-af811239cf77 1073741824 Aug 26 16:27:29 devstack sudo[112727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:29 devstack sudo[112717]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21bb2363-9763-4bcf-b3f2-e61ee3a47638__8imif0i" returned: 1 in 0.523s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21bb2363-9763-4bcf-b3f2-e61ee3a47638__8imif0i' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b91aa7c-66c8-48fc-8ba8-1cbfdedf5ca7]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:29 devstack sudo[112731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD Aug 26 16:27:29 devstack sudo[112731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:29 devstack sudo[112731]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:29 devstack sudo[112727]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a75296fd-6157-4b2a-b3cb-af811239cf77 1073741824" returned: 0 in 0.535s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:29 devstack sudo[112739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD Aug 26 16:27:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a75296fd-6157-4b2a-b3cb-af811239cf77 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:29 devstack sudo[112739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:29 devstack sudo[112741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a75296fd-6157-4b2a-b3cb-af811239cf77 Aug 26 16:27:29 devstack sudo[112741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:30 devstack sudo[112739]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] 21bb2363-9763-4bcf-b3f2-e61ee3a47638 was raw, converting to qcow2 {{(pid=94407) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:30 devstack sudo[112747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 Aug 26 16:27:30 devstack sudo[112747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:30 devstack sudo[112741]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a75296fd-6157-4b2a-b3cb-af811239cf77" returned: 0 in 0.293s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bc9939-00e7-4cb8-abe3-d5d241ee225c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a75296fd-6157-4b2a-b3cb-af811239cf77', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c783dcc3-981f-4bff-be9e-1e20f672ca8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:30 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Volume volume-a75296fd-6157-4b2a-b3cb-af811239cf77 (a75296fd-6157-4b2a-b3cb-af811239cf77): created successfully Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c783dcc3-981f-4bff-be9e-1e20f672ca8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Flow 'volume_create_manager' (5533c5c3-0e43-4845-a656-a4d4461c499a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:30 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c79f2eda-b07e-4c36-9659-65ce1aad3e15 tempest-ProjectReaderTests-519087225 None] Created volume successfully. Aug 26 16:27:30 devstack sudo[112747]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756" returned: 0 in 0.527s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21bb2363-9763-4bcf-b3f2-e61ee3a47638_m7p3e6gydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:27:30 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 16:27:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:30 devstack sudo[112753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 1G Aug 26 16:27:30 devstack sudo[112753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:31 devstack sudo[112753]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 1G" returned: 0 in 0.356s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Downloaded image 21bb2363-9763-4bcf-b3f2-e61ee3a47638 ((None, [{'url': 'file:///opt/stack/data/glance/images/21bb2363-9763-4bcf-b3f2-e61ee3a47638', 'metadata': {}}])) to volume c4188891-4bc5-490c-95e8-6e38345ce756 successfully. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Temporary image 21bb2363-9763-4bcf-b3f2-e61ee3a47638 for user fcc1844cc87e47ae9454f43547ee283f is deleted. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Marking volume c4188891-4bc5-490c-95e8-6e38345ce756 as bootable. {{(pid=94407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Copying metadata from image 21bb2363-9763-4bcf-b3f2-e61ee3a47638 to c4188891-4bc5-490c-95e8-6e38345ce756. {{(pid=94407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Creating volume glance metadata for volume c4188891-4bc5-490c-95e8-6e38345ce756 backed by image 21bb2363-9763-4bcf-b3f2-e61ee3a47638 with: {'image_id': '21bb2363-9763-4bcf-b3f2-e61ee3a47638', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6cab1620e81204cbb7ad3919d1aaaf75', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fe1a19-1463-47ad-8b2e-dd390229132f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4188891-4bc5-490c-95e8-6e38345ce756', 'volume_size': 1, 'image_id': '21bb2363-9763-4bcf-b3f2-e61ee3a47638', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21bb2363-9763-4bcf-b3f2-e61ee3a47638', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6cab1620e81204cbb7ad3919d1aaaf75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca6d266b8ea947e6bd3026794bc58db5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3b1896df8270c02214b9a545bde407822e564ebb4242596328ce770b9b90a185465543c51884039ca4353e12d686e9c92fd53311cde12817be490a7ba0103e50', 'id': '21bb2363-9763-4bcf-b3f2-e61ee3a47638', 'created_at': datetime.datetime(2026, 8, 26, 14, 27, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 27, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21bb2363-9763-4bcf-b3f2-e61ee3a47638/file', 'properties': {}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50deb96a-5929-4eb7-ba44-860a6f691bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:31 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Volume volume-c4188891-4bc5-490c-95e8-6e38345ce756 (c4188891-4bc5-490c-95e8-6e38345ce756): created successfully Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50deb96a-5929-4eb7-ba44-860a6f691bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Flow 'volume_create_manager' (d4b653de-19de-49de-bae9-76b19a7b8585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:31 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ada1b5e1-14f7-4d58-b937-9af41ab51d9e tempest-VolumeImageDependencyTests-2073237781 None] Created volume successfully. Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Acquiring lock "cinder-a75296fd-6157-4b2a-b3cb-af811239cf77-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Lock "cinder-a75296fd-6157-4b2a-b3cb-af811239cf77-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Acquiring lock "cinder-quobyte-a75296fd-6157-4b2a-b3cb-af811239cf77" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Acquiring lock "cinder-c4188891-4bc5-490c-95e8-6e38345ce756-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Lock "cinder-quobyte-a75296fd-6157-4b2a-b3cb-af811239cf77" acquired by "delete_volume" :: waited 0.033s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc6821b-fdad-4bad-9dec-96d4a145eac8]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a75296fd-6157-4b2a-b3cb-af811239cf77 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Lock "cinder-c4188891-4bc5-490c-95e8-6e38345ce756-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Acquiring lock "cinder-quobyte-c4188891-4bc5-490c-95e8-6e38345ce756" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:31 devstack sudo[112760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a75296fd-6157-4b2a-b3cb-af811239cf77 Aug 26 16:27:31 devstack sudo[112760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Lock "cinder-quobyte-c4188891-4bc5-490c-95e8-6e38345ce756" acquired by "delete_volume" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ede085-a594-4893-a10a-ac00fae95d05]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:32 devstack sudo[112774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 Aug 26 16:27:32 devstack sudo[112774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:32 devstack sudo[112760]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a75296fd-6157-4b2a-b3cb-af811239cf77" returned: 0 in 0.799s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a75296fd-6157-4b2a-b3cb-af811239cf77 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:32 devstack sudo[112809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a75296fd-6157-4b2a-b3cb-af811239cf77 Aug 26 16:27:32 devstack sudo[112809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:32 devstack sudo[112774]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756" returned: 0 in 0.672s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:32 devstack sudo[112819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756 Aug 26 16:27:32 devstack sudo[112819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:32 devstack sudo[112809]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a75296fd-6157-4b2a-b3cb-af811239cf77" returned: 0 in 0.520s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Lock "cinder-quobyte-a75296fd-6157-4b2a-b3cb-af811239cf77" released by "delete_volume" :: held 1.396s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:32 devstack sudo[112819]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c4188891-4bc5-490c-95e8-6e38345ce756" returned: 0 in 0.415s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Lock "cinder-quobyte-c4188891-4bc5-490c-95e8-6e38345ce756" released by "delete_volume" :: held 1.204s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Created reservations ['7767b6cb-f1e9-48d2-adc1-00b1b05e481d', 'c2b63304-2983-4a13-abff-95bc79dde949', 'bb65d0bd-3c96-4734-9a25-ae8a8eaf551f', 'b882facd-949d-4ee4-8eec-bc64498333ff'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Created reservations ['97c9760e-e59d-426d-92cc-eb140f12fab8', 'fd8230be-c5c7-434e-8309-31e6b35bac65', 'b1040a0f-ed79-4eb7-a82a-8cd346286cf8', '1fed4d22-d4f4-4f3e-9abc-91188f61bb44'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:33 devstack sudo[112841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:33 devstack sudo[112841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:33 devstack sudo[112846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:33 devstack sudo[112846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:33 devstack sudo[112841]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.324s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:33 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Deleted volume successfully. Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e4173023-cbde-41ce-975e-a3ec107f5142 tempest-ProjectReaderTests-519087225 None] Lock "cinder-a75296fd-6157-4b2a-b3cb-af811239cf77-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:33 devstack sudo[112846]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.337s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:33 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Deleted volume successfully. Aug 26 16:27:33 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1ff6faf4-d298-4ba2-aa86-18f041843491 tempest-VolumeImageDependencyTests-2073237781 None] Lock "cinder-c4188891-4bc5-490c-95e8-6e38345ce756-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Flow 'volume_create_manager' (4c99fba5-6152-4102-8f52-24d839134284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7615c36-573f-4628-97e4-1363f54b423a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7615c36-573f-4628-97e4-1363f54b423a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039443978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5946a92d-7a20-4c28-be0c-00d0b2b23367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d6cc69827d420ba0e384aff3834468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:34Z,use_quota=True,user_id='81595c00860b427c9d16ff657521d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38f481c-c5b9-4709-adf6-149999aa2520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38f481c-c5b9-4709-adf6-149999aa2520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67318286-39bc-4739-99f0-c26998034497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67318286-39bc-4739-99f0-c26998034497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5946a92d-7a20-4c28-be0c-00d0b2b23367', 'volume_name': 'volume-5946a92d-7a20-4c28-be0c-00d0b2b23367', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315870aa-6d0c-4330-9d1f-6ca4cfe7d0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315870aa-6d0c-4330-9d1f-6ca4cfe7d0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12106856-4dba-46c3-adf0-2f6d54f2edb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:34 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Volume 5946a92d-7a20-4c28-be0c-00d0b2b23367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5946a92d-7a20-4c28-be0c-00d0b2b23367', 'volume_size': 1} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039443978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5946a92d-7a20-4c28-be0c-00d0b2b23367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d6cc69827d420ba0e384aff3834468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:34Z,use_quota=True,user_id='81595c00860b427c9d16ff657521d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Creating volume 5946a92d-7a20-4c28-be0c-00d0b2b23367 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:34 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5946a92d-7a20-4c28-be0c-00d0b2b23367 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:34 devstack sudo[112866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5946a92d-7a20-4c28-be0c-00d0b2b23367 1073741824 Aug 26 16:27:34 devstack sudo[112866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:35 devstack sudo[112866]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5946a92d-7a20-4c28-be0c-00d0b2b23367 1073741824" returned: 0 in 0.578s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5946a92d-7a20-4c28-be0c-00d0b2b23367 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:35 devstack sudo[112872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5946a92d-7a20-4c28-be0c-00d0b2b23367 Aug 26 16:27:35 devstack sudo[112872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:35 devstack sudo[112872]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5946a92d-7a20-4c28-be0c-00d0b2b23367" returned: 0 in 0.295s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12106856-4dba-46c3-adf0-2f6d54f2edb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5946a92d-7a20-4c28-be0c-00d0b2b23367', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87886b6-99ba-423c-a32b-d91d64876c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:35 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Volume volume-5946a92d-7a20-4c28-be0c-00d0b2b23367 (5946a92d-7a20-4c28-be0c-00d0b2b23367): created successfully Aug 26 16:27:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87886b6-99ba-423c-a32b-d91d64876c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Flow 'volume_create_manager' (4c99fba5-6152-4102-8f52-24d839134284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:35 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-915e8143-cfe3-4922-8e65-c9e60cc992fc tempest-ProjectReaderTests-519087225 None] Created volume successfully. Aug 26 16:27:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Acquiring lock "cinder-5946a92d-7a20-4c28-be0c-00d0b2b23367-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Lock "cinder-5946a92d-7a20-4c28-be0c-00d0b2b23367-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Acquiring lock "cinder-quobyte-5946a92d-7a20-4c28-be0c-00d0b2b23367" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Lock "cinder-quobyte-5946a92d-7a20-4c28-be0c-00d0b2b23367" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:36 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f33ed9-d36c-4f96-9b55-e41d3a767574]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5946a92d-7a20-4c28-be0c-00d0b2b23367 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:36 devstack sudo[112894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5946a92d-7a20-4c28-be0c-00d0b2b23367 Aug 26 16:27:36 devstack sudo[112894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:37 devstack sudo[112894]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5946a92d-7a20-4c28-be0c-00d0b2b23367" returned: 0 in 0.529s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5946a92d-7a20-4c28-be0c-00d0b2b23367 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:37 devstack sudo[112909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5946a92d-7a20-4c28-be0c-00d0b2b23367 Aug 26 16:27:37 devstack sudo[112909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-5946a92d-7a20-4c28-be0c-00d0b2b23367" returned: 0 in 0.331s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:37 devstack sudo[112909]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:37 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Lock "cinder-quobyte-5946a92d-7a20-4c28-be0c-00d0b2b23367" released by "delete_volume" :: held 0.958s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:37 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Created reservations ['36ff9980-65df-44e0-a974-a27c82011067', '33d37f53-7571-4f4d-aa98-6271864e40dc', '3d22c0f3-e243-4335-89c2-a567e6db01ad', '5a1d4130-7a1b-408a-a912-63d0c15b2024'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:37 devstack sudo[112914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:37 devstack sudo[112914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:38 devstack sudo[112914]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.282s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:38 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:38 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Deleted volume successfully. Aug 26 16:27:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c823d0f2-b1e7-4167-8ca5-014d4db5d5a2 tempest-ProjectReaderTests-519087225 None] Lock "cinder-5946a92d-7a20-4c28-be0c-00d0b2b23367-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Flow 'volume_create_manager' (ad9309a2-aa05-4f21-b87b-bc03cd9ab351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5000be0-a583-4b42-9ce9-912bb360326a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5000be0-a583-4b42-9ce9-912bb360326a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960653684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b42b97a-f732-449e-b516-4595f77f1857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d6cc69827d420ba0e384aff3834468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:39Z,use_quota=True,user_id='81595c00860b427c9d16ff657521d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bfc130-6b7d-4c9f-baf1-fb7485d40ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bfc130-6b7d-4c9f-baf1-fb7485d40ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80eab7c1-3716-4c17-b666-6865cc6994c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80eab7c1-3716-4c17-b666-6865cc6994c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b42b97a-f732-449e-b516-4595f77f1857', 'volume_name': 'volume-9b42b97a-f732-449e-b516-4595f77f1857', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6da49b-adb9-480b-98d3-ab39b4002442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6da49b-adb9-480b-98d3-ab39b4002442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fb3c43-dbdb-4a87-bbd6-652b6dd7f21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:39 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Volume 9b42b97a-f732-449e-b516-4595f77f1857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b42b97a-f732-449e-b516-4595f77f1857', 'volume_size': 1} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960653684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b42b97a-f732-449e-b516-4595f77f1857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d6cc69827d420ba0e384aff3834468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:39Z,use_quota=True,user_id='81595c00860b427c9d16ff657521d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Creating volume 9b42b97a-f732-449e-b516-4595f77f1857 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:39 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9b42b97a-f732-449e-b516-4595f77f1857 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:39 devstack sudo[112917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9b42b97a-f732-449e-b516-4595f77f1857 1073741824 Aug 26 16:27:39 devstack sudo[112917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:39 devstack sudo[112917]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9b42b97a-f732-449e-b516-4595f77f1857 1073741824" returned: 0 in 0.499s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9b42b97a-f732-449e-b516-4595f77f1857 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:40 devstack sudo[112923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9b42b97a-f732-449e-b516-4595f77f1857 Aug 26 16:27:40 devstack sudo[112923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:40 devstack sudo[112923]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9b42b97a-f732-449e-b516-4595f77f1857" returned: 0 in 0.276s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fb3c43-dbdb-4a87-bbd6-652b6dd7f21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b42b97a-f732-449e-b516-4595f77f1857', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841a9f4d-1241-4679-ad6e-fd3f42c4e986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:40 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Volume volume-9b42b97a-f732-449e-b516-4595f77f1857 (9b42b97a-f732-449e-b516-4595f77f1857): created successfully Aug 26 16:27:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841a9f4d-1241-4679-ad6e-fd3f42c4e986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Flow 'volume_create_manager' (ad9309a2-aa05-4f21-b87b-bc03cd9ab351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:40 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-318663b9-dc9d-4d86-9607-f977c49e4e93 tempest-ProjectReaderTests-519087225 None] Created volume successfully. Aug 26 16:27:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Acquiring lock "cinder-9b42b97a-f732-449e-b516-4595f77f1857-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Lock "cinder-9b42b97a-f732-449e-b516-4595f77f1857-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Acquiring lock "cinder-quobyte-9b42b97a-f732-449e-b516-4595f77f1857" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Lock "cinder-quobyte-9b42b97a-f732-449e-b516-4595f77f1857" acquired by "delete_volume" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:41 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a66b6af-3cdf-4874-9cc3-df39754f29d4]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9b42b97a-f732-449e-b516-4595f77f1857 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:41 devstack sudo[112927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9b42b97a-f732-449e-b516-4595f77f1857 Aug 26 16:27:41 devstack sudo[112927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:42 devstack sudo[112927]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9b42b97a-f732-449e-b516-4595f77f1857" returned: 0 in 0.415s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9b42b97a-f732-449e-b516-4595f77f1857 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:42 devstack sudo[112934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9b42b97a-f732-449e-b516-4595f77f1857 Aug 26 16:27:42 devstack sudo[112934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:42 devstack sudo[112934]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9b42b97a-f732-449e-b516-4595f77f1857" returned: 0 in 0.246s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Lock "cinder-quobyte-9b42b97a-f732-449e-b516-4595f77f1857" released by "delete_volume" :: held 0.714s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Created reservations ['5121b8d3-0191-41ee-8102-df62983ede74', '1f1f3ba1-7070-45c1-b127-ba1adafdfaba', 'f84676d2-55ed-4c28-a542-fdeb01e6cc98', 'd0c5fca9-b2ab-41b0-a652-9ea55b8ced6a'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:42 devstack sudo[112937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:42 devstack sudo[112937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:42 devstack sudo[112937]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.253s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:42 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Deleted volume successfully. Aug 26 16:27:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a9606f42-5931-45da-a1dc-5fc55d72927d tempest-ProjectReaderTests-519087225 None] Lock "cinder-9b42b97a-f732-449e-b516-4595f77f1857-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Acquiring lock "cinder-c0eadd80-1e53-49c4-b6c2-2d85d124cd20-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Lock "cinder-c0eadd80-1e53-49c4-b6c2-2d85d124cd20-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Acquiring lock "cinder-quobyte-c0eadd80-1e53-49c4-b6c2-2d85d124cd20" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Lock "cinder-quobyte-c0eadd80-1e53-49c4-b6c2-2d85d124cd20" acquired by "delete_volume" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:45 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[63722b44-d2e9-40ac-b5ae-906d0b37f009]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:45 devstack sudo[112943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20 Aug 26 16:27:45 devstack sudo[112943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:46 devstack sudo[112943]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20" returned: 0 in 0.401s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:46 devstack sudo[112948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20 Aug 26 16:27:46 devstack sudo[112948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:46 devstack sudo[112948]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c0eadd80-1e53-49c4-b6c2-2d85d124cd20" returned: 0 in 0.247s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Lock "cinder-quobyte-c0eadd80-1e53-49c4-b6c2-2d85d124cd20" released by "delete_volume" :: held 0.691s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Created reservations ['a3f3d9cc-ed6a-4455-a90b-8adc1881270a', '0a2146ad-85b6-48ea-8d39-65369691b444', 'a142fb81-0e4b-4fc2-8e60-4e444b07ef08', 'bb55476e-5395-4195-b6e2-bac67ab6c908'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:46 devstack sudo[112951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:27:46 devstack sudo[112951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:46 devstack sudo[112951]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.247s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:27:46 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Deleted volume successfully. Aug 26 16:27:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f156c805-506c-4295-8c1a-e29b06c3bda8 tempest-VolumesNegativeTest-921237223 None] Lock "cinder-c0eadd80-1e53-49c4-b6c2-2d85d124cd20-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Flow 'volume_create_manager' (feb1871c-1739-41c9-bee1-3abb56da6007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a646583a-97ad-463d-9050-aa1819ccf1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a646583a-97ad-463d-9050-aa1819ccf1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1103331484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b937fd5b-c319-42d6-90b7-06f8e1a6f14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9569d5349fc34e03904634c67910fcc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:49Z,use_quota=True,user_id='d65d8b820753402cbec57bd734323dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931afa94-8585-4aae-8c6b-a0414b282a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931afa94-8585-4aae-8c6b-a0414b282a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40e304e-5682-44db-bc97-ada93b09bf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40e304e-5682-44db-bc97-ada93b09bf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b937fd5b-c319-42d6-90b7-06f8e1a6f14a', 'volume_name': 'volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73eb29a2-c5ed-4d51-9ede-3ac09c9a7c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73eb29a2-c5ed-4d51-9ede-3ac09c9a7c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a71f67-c463-48b6-82b4-57a122205827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:49 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Volume b937fd5b-c319-42d6-90b7-06f8e1a6f14a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a', 'volume_size': 1} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1103331484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b937fd5b-c319-42d6-90b7-06f8e1a6f14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9569d5349fc34e03904634c67910fcc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:27:49Z,use_quota=True,user_id='d65d8b820753402cbec57bd734323dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Creating volume b937fd5b-c319-42d6-90b7-06f8e1a6f14a {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:27:49 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:49 devstack sudo[112954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a 1073741824 Aug 26 16:27:49 devstack sudo[112954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:49 devstack sudo[112954]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a 1073741824" returned: 0 in 0.545s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:50 devstack sudo[112960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a Aug 26 16:27:50 devstack sudo[112960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:50 devstack sudo[112960]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" returned: 0 in 0.274s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:27:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a71f67-c463-48b6-82b4-57a122205827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d06ff0-fb39-45e2-9603-56633d945e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:27:50 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Volume volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a (b937fd5b-c319-42d6-90b7-06f8e1a6f14a): created successfully Aug 26 16:27:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d06ff0-fb39-45e2-9603-56633d945e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:27:50 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Flow 'volume_create_manager' (feb1871c-1739-41c9-bee1-3abb56da6007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:27:50 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5cc2a7d6-fa1c-45a4-beb5-3428e2b39ae9 tempest-VolumesSnapshotListTestJSON-159896467 None] Created volume successfully. Aug 26 16:27:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] Creating offline snapshot 1bfe1f8e-da58-48e4-b480-2ad5a2afa639 of volume b937fd5b-c319-42d6-90b7-06f8e1a6f14a {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:27:51 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0d8343-2736-4f86-a104-2cc0a61e3125]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:51 devstack sudo[112963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a Aug 26 16:27:51 devstack sudo[112963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:52 devstack sudo[112963]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" returned: 0 in 0.396s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:52 devstack sudo[112968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 1G Aug 26 16:27:52 devstack sudo[112968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:52 devstack sudo[112968]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 1G" returned: 0 in 0.392s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:52 devstack sudo[112974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 Aug 26 16:27:52 devstack sudo[112974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:52 devstack sudo[112974]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639" returned: 0 in 0.301s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:52 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 is being set with open permissions: ugo+rw Aug 26 16:27:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:52 devstack sudo[112979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 Aug 26 16:27:52 devstack sudo[112979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:53 devstack sudo[112979]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639" returned: 0 in 0.269s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:53 devstack sudo[112982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.info Aug 26 16:27:53 devstack sudo[112982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:53 devstack sudo[112982]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.info" returned: 0 in 0.267s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:53 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.info is being set with open permissions: ugo+rw Aug 26 16:27:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:53 devstack sudo[112985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.info Aug 26 16:27:53 devstack sudo[112985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:53 devstack sudo[112985]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.info" returned: 0 in 0.268s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:53 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=306,cinder:SELECT=248,cinder:INSERT=95,cinder:DELETE=27 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:27:53 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=200,cinder:INSERT=79,cinder:UPDATE=334,cinder:DELETE=26 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:27:53 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-882d15db-d1f9-4eae-934c-952a167d6699 tempest-VolumesSnapshotListTestJSON-159896467 None] Create snapshot completed successfully Aug 26 16:27:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] Creating offline snapshot 6c80fc31-4cca-44fa-8b64-4752685c445f of volume b937fd5b-c319-42d6-90b7-06f8e1a6f14a {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:27:54 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0014107a-fbdb-4d69-afa6-3938759df03b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:54 devstack sudo[112988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 Aug 26 16:27:54 devstack sudo[112988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:54 devstack sudo[112988]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639" returned: 0 in 0.404s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:27:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:54 devstack sudo[112993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f 1G Aug 26 16:27:54 devstack sudo[112993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:54 devstack sudo[112993]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f 1G" returned: 0 in 0.462s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:54 devstack sudo[112999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f Aug 26 16:27:54 devstack sudo[112999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:55 devstack sudo[112999]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f" returned: 0 in 0.314s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:55 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f is being set with open permissions: ugo+rw Aug 26 16:27:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:55 devstack sudo[113004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f Aug 26 16:27:55 devstack sudo[113004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:55 devstack sudo[113004]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f" returned: 0 in 0.268s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.569s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e493de0d-080d-4731-a1d2-59b11af63a52 tempest-VolumesSnapshotListTestJSON-159896467 None] Create snapshot completed successfully Aug 26 16:27:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:27:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:27:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] Creating offline snapshot b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 of volume b937fd5b-c319-42d6-90b7-06f8e1a6f14a {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:27:56 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5918ca6-62a4-476a-8e76-5de3ea905c23]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:56 devstack sudo[113007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f Aug 26 16:27:56 devstack sudo[113007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:56 devstack sudo[113007]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f" returned: 0 in 0.362s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:27:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:56 devstack sudo[113013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 1G Aug 26 16:27:56 devstack sudo[113013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:57 devstack sudo[113013]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 1G" returned: 0 in 0.487s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:57 devstack sudo[113019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 Aug 26 16:27:57 devstack sudo[113019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:57 devstack sudo[113019]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7" returned: 0 in 0.328s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:57 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 is being set with open permissions: ugo+rw Aug 26 16:27:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:57 devstack sudo[113025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 Aug 26 16:27:57 devstack sudo[113025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:57 devstack sudo[113025]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7" returned: 0 in 0.243s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.513s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:27:57 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8094db85-2623-47a2-935d-3f8bdd386ec2 tempest-VolumesSnapshotListTestJSON-159896467 None] Create snapshot completed successfully Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "cinder-b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "cinder-quobyte-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "cinder-quobyte-b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Deleting offline snapshot b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 of volume b937fd5b-c319-42d6-90b7-06f8e1a6f14a {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] snapshot_file for this snap is: volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[3486af8a-01a7-492b-9c8c-dff07397a5fc]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:59 devstack sudo[113028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 Aug 26 16:27:59 devstack sudo[113028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:27:59 devstack sudo[113028]: pam_unix(sudo:session): session closed for user root Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7" returned: 0 in 0.376s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7fce2e-1ca4-4417-87d5-4f9b43d62452]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:27:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:27:59 devstack sudo[113033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f Aug 26 16:27:59 devstack sudo[113033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:00 devstack sudo[113033]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f" returned: 0 in 0.371s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:28:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:00 devstack sudo[113038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 Aug 26 16:28:00 devstack sudo[113038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:00 devstack sudo[113038]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7" returned: 0 in 0.437s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:00 devstack sudo[113044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7 Aug 26 16:28:00 devstack sudo[113044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:00 devstack sudo[113044]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7" returned: 0 in 0.286s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7" released by "_delete_snapshot" :: held 1.583s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" released by "delete_snapshot" :: held 1.608s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Created reservations ['cc33edba-fef6-4566-aec4-e76af65193d5', '5baa5c2d-44e2-4bc7-86f4-c5891883da43', '39ff2eed-0ac2-4c74-8779-368a33623fb9', 'cce88149-21bd-4541-9443-818c4915f2aa'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Delete snapshot completed successfully. Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6aeb038e-cf62-4896-bf2a-0819e19602e6 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-b6d3e7dd-6dbe-4d51-929b-f1a866ce01e7-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "cinder-6c80fc31-4cca-44fa-8b64-4752685c445f-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-6c80fc31-4cca-44fa-8b64-4752685c445f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "cinder-quobyte-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "cinder-quobyte-6c80fc31-4cca-44fa-8b64-4752685c445f" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-6c80fc31-4cca-44fa-8b64-4752685c445f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Deleting offline snapshot 6c80fc31-4cca-44fa-8b64-4752685c445f of volume b937fd5b-c319-42d6-90b7-06f8e1a6f14a {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] snapshot_file for this snap is: volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[9653ec6f-2f94-4c9b-ae75-c3808e70552a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:01 devstack sudo[113047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f Aug 26 16:28:01 devstack sudo[113047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:01 devstack sudo[113047]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f" returned: 0 in 0.362s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbf9ee5-9d0f-4c2b-b6aa-cbec80a32ab5]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:02 devstack sudo[113052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 Aug 26 16:28:02 devstack sudo[113052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:02 devstack sudo[113052]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639" returned: 0 in 0.368s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:28:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:02 devstack sudo[113057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f Aug 26 16:28:02 devstack sudo[113057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:02 devstack sudo[113057]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f" returned: 0 in 0.394s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:02 devstack sudo[113063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f Aug 26 16:28:02 devstack sudo[113063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:03 devstack sudo[113063]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.6c80fc31-4cca-44fa-8b64-4752685c445f" returned: 0 in 0.263s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-6c80fc31-4cca-44fa-8b64-4752685c445f" released by "_delete_snapshot" :: held 1.508s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" released by "delete_snapshot" :: held 1.529s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Created reservations ['6412dadb-5714-4536-9c06-326c70c48041', '294dcd14-0455-46e8-893a-b34ab94f2994', '9275d2b9-f16a-47bd-a667-92241bed3ec2', '2a4c6e69-26ff-4861-971c-9911539dae7b'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:03 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Delete snapshot completed successfully. Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-954e38cc-1c09-497d-8e15-e6f2e9af6804 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-6c80fc31-4cca-44fa-8b64-4752685c445f-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "cinder-1bfe1f8e-da58-48e4-b480-2ad5a2afa639-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-1bfe1f8e-da58-48e4-b480-2ad5a2afa639-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "cinder-quobyte-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "cinder-quobyte-1bfe1f8e-da58-48e4-b480-2ad5a2afa639" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-1bfe1f8e-da58-48e4-b480-2ad5a2afa639" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Deleting offline snapshot 1bfe1f8e-da58-48e4-b480-2ad5a2afa639 of volume b937fd5b-c319-42d6-90b7-06f8e1a6f14a {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] snapshot_file for this snap is: volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3edab2-858d-48a7-8294-1034902bfa6c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:03 devstack sudo[113066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 Aug 26 16:28:03 devstack sudo[113066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:04 devstack sudo[113066]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639" returned: 0 in 0.472s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:28:04 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff48468-3e1b-4b11-971a-3e9c1a32376c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:04 devstack sudo[113071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a Aug 26 16:28:04 devstack sudo[113071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:04 devstack sudo[113071]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" returned: 0 in 0.441s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:04 devstack sudo[113079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 Aug 26 16:28:04 devstack sudo[113079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:05 devstack sudo[113079]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639" returned: 0 in 0.366s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:05 devstack sudo[113084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639 Aug 26 16:28:05 devstack sudo[113084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Flow 'volume_create_manager' (946b2e95-ea29-42dd-9463-4fd3ce060b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7eb3ca8-474e-4494-a094-b8f0411fa57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7eb3ca8-474e-4494-a094-b8f0411fa57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1454141328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5e4ff8-9c0a-4b76-92be-c919e4a21f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b48376938d2642c0bd2c47dce961380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:28:05Z,use_quota=True,user_id='687e9171ebb746768ec838c16286190a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e1a9e5-6406-49f4-9503-47b2cb6d756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e1a9e5-6406-49f4-9503-47b2cb6d756a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a014c2b-f6c4-4675-a236-55cdad2e425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a014c2b-f6c4-4675-a236-55cdad2e425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f5e4ff8-9c0a-4b76-92be-c919e4a21f02', 'volume_name': 'volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f0923d-8fb6-4be4-af96-ba9e620de3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f0923d-8fb6-4be4-af96-ba9e620de3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0a7683-6adf-4e51-87b9-43176118396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:05 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Volume 4f5e4ff8-9c0a-4b76-92be-c919e4a21f02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02', 'volume_size': 1} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1454141328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5e4ff8-9c0a-4b76-92be-c919e4a21f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b48376938d2642c0bd2c47dce961380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:28:05Z,use_quota=True,user_id='687e9171ebb746768ec838c16286190a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Creating volume 4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:28:05 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:05 devstack sudo[113086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 1073741824 Aug 26 16:28:05 devstack sudo[113086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:05 devstack sudo[113084]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a.1bfe1f8e-da58-48e4-b480-2ad5a2afa639" returned: 0 in 0.244s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-1bfe1f8e-da58-48e4-b480-2ad5a2afa639" released by "_delete_snapshot" :: held 1.643s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" released by "delete_snapshot" :: held 1.665s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Created reservations ['1c78cd5b-08ec-4987-b008-402c82facca2', '68839093-9fdb-4abe-8f46-6fcf71a7fd69', '4c9ac5d8-c8a5-4838-b102-99a15df56ec3', '5bed1bc6-5c79-4e6a-921a-ba819aa28754'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:05 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Delete snapshot completed successfully. Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b5bbee16-800c-40c8-8785-af316f2ac735 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-1bfe1f8e-da58-48e4-b480-2ad5a2afa639-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:05 devstack sudo[113086]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 1073741824" returned: 0 in 0.434s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:05 devstack sudo[113093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 Aug 26 16:28:05 devstack sudo[113093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "cinder-b937fd5b-c319-42d6-90b7-06f8e1a6f14a-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-b937fd5b-c319-42d6-90b7-06f8e1a6f14a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:05 devstack sudo[113093]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02" returned: 0 in 0.273s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:28:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "cinder-quobyte-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0a7683-6adf-4e51-87b9-43176118396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17470f1-a4e4-4cfb-9321-9b40daa901e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" acquired by "delete_volume" :: waited 0.027s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:06 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Volume volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 (4f5e4ff8-9c0a-4b76-92be-c919e4a21f02): created successfully Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17470f1-a4e4-4cfb-9321-9b40daa901e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Flow 'volume_create_manager' (946b2e95-ea29-42dd-9463-4fd3ce060b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0143b571-f7f9-4a76-af49-484c81459b20]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-835d4d0b-0a79-45dd-acd4-2a78e8cc11d6 tempest-SnapshotDependencyTests-861429089 None] Created volume successfully. Aug 26 16:28:06 devstack sudo[113096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a Aug 26 16:28:06 devstack sudo[113096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] Creating offline snapshot 1a257889-c047-4108-943a-7e7292aacb9a of volume 4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaced8c-1eb2-434d-b8d0-b0f35824dc6c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:06 devstack sudo[113096]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" returned: 0 in 0.388s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:06 devstack sudo[113102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a Aug 26 16:28:06 devstack sudo[113102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:06 devstack sudo[113101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 Aug 26 16:28:06 devstack sudo[113101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:06 devstack sudo[113102]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" returned: 0 in 0.256s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-quobyte-b937fd5b-c319-42d6-90b7-06f8e1a6f14a" released by "delete_volume" :: held 0.722s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Created reservations ['2ceb8059-72a8-48a9-a567-7bc935c66f94', '2ebdfbd2-7a94-431e-aebb-2a7f9a2f613d', 'b5ba2e84-9e90-4117-8aea-5df8f6e3c2e3', 'f3356161-fa76-4643-992e-46b655c39ca6'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:06 devstack sudo[113101]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02" returned: 0 in 0.365s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:06 devstack sudo[113109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a 1G Aug 26 16:28:06 devstack sudo[113109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:06 devstack sudo[113111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:28:06 devstack sudo[113111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:07 devstack sudo[113111]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.247s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:07 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:28:07 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Deleted volume successfully. Aug 26 16:28:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-63cc7ded-adc7-4055-afd0-ce7752eff7f8 tempest-VolumesSnapshotListTestJSON-159896467 None] Lock "cinder-b937fd5b-c319-42d6-90b7-06f8e1a6f14a-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:07 devstack sudo[113109]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a 1G" returned: 0 in 0.420s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:07 devstack sudo[113118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a Aug 26 16:28:07 devstack sudo[113118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:07 devstack sudo[113118]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a" returned: 0 in 0.296s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:07 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a is being set with open permissions: ugo+rw Aug 26 16:28:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:07 devstack sudo[113124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a Aug 26 16:28:07 devstack sudo[113124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:07 devstack sudo[113124]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a" returned: 0 in 0.252s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:07 devstack sudo[113127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.info Aug 26 16:28:07 devstack sudo[113127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:08 devstack sudo[113127]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.info" returned: 0 in 0.273s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:08 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.info is being set with open permissions: ugo+rw Aug 26 16:28:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:08 devstack sudo[113130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.info Aug 26 16:28:08 devstack sudo[113130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:08 devstack sudo[113130]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.info" returned: 0 in 0.248s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0a367ed9-bcba-4e33-82b6-5c34ead24078 tempest-SnapshotDependencyTests-861429089 None] Create snapshot completed successfully Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Flow 'volume_create_manager' (115e4f98-7361-4b4f-a9f3-d03a14c80993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ab6080-0d08-4319-8727-46fce3e40d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ab6080-0d08-4319-8727-46fce3e40d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ba4c55-b0a9-4be1-9987-3124d69cdf70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b48376938d2642c0bd2c47dce961380a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a257889-c047-4108-943a-7e7292aacb9a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:28:09Z,use_quota=True,user_id='687e9171ebb746768ec838c16286190a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ebc24c-4885-4da7-9130-414ac0e7eb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ebc24c-4885-4da7-9130-414ac0e7eb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda485f1-7306-4d35-b44a-5a1844283310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda485f1-7306-4d35-b44a-5a1844283310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '62ba4c55-b0a9-4be1-9987-3124d69cdf70', 'volume_name': 'volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70', 'volume_size': 1, 'snapshot_id': '1a257889-c047-4108-943a-7e7292aacb9a'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e054ce-c9c0-4651-9b4c-15a78ba68d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e054ce-c9c0-4651-9b4c-15a78ba68d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f62ed39-94c3-483c-95a6-9b83e5ed15c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:09 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Volume 62ba4c55-b0a9-4be1-9987-3124d69cdf70: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70', 'volume_size': 1, 'snapshot_id': '1a257889-c047-4108-943a-7e7292aacb9a'} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "cinder-quobyte-1a257889-c047-4108-943a-7e7292aacb9a-62ba4c55-b0a9-4be1-9987-3124d69cdf70" by "_create_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-quobyte-1a257889-c047-4108-943a-7e7292aacb9a-62ba4c55-b0a9-4be1-9987-3124d69cdf70" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Creating volume 62ba4c55-b0a9-4be1-9987-3124d69cdf70 from snapshot 1a257889-c047-4108-943a-7e7292aacb9a {{(pid=94407) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "cinder-quobyte-62ba4c55-b0a9-4be1-9987-3124d69cdf70" by "_copy_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-quobyte-62ba4c55-b0a9-4be1-9987-3124d69cdf70" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] snapshot: 1a257889-c047-4108-943a-7e7292aacb9a, volume: 62ba4c55-b0a9-4be1-9987-3124d69cdf70, {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f86ba7-1c29-4de9-af34-26dbd887994a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:09 devstack sudo[113133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a Aug 26 16:28:09 devstack sudo[113133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:09 devstack sudo[113133]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a" returned: 0 in 0.366s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fbc1bc-dc2f-4ec3-b25e-e96493097b80]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:09 devstack sudo[113139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 Aug 26 16:28:09 devstack sudo[113139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:28:10 devstack sudo[113139]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Flow 'volume_create_manager' (d51603b4-f75f-4501-a19f-33084d38b4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4218d8-2104-40e0-96a3-54562d18b4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02" returned: 0 in 0.427s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] will copy from snapshot at /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Creating direct copy from snapshot {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.utils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Path /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70 not found in is_blk_device check {{(pid=94407) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:10 devstack sudo[113144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70 Aug 26 16:28:10 devstack sudo[113144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4218d8-2104-40e0-96a3-54562d18b4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-429091656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6a85b9-efaf-402f-8634-bde0349d2a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4192ce7b07ca4be5967663ac3670ce19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:28:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:28:10Z,use_quota=True,user_id='7784caf29125461096e588be3ac8c4ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b1197c-3e27-4a6a-b139-5dbd09ffce5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b1197c-3e27-4a6a-b139-5dbd09ffce5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b43af50-8b45-4f2b-b7a0-dc4b1ec98b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b43af50-8b45-4f2b-b7a0-dc4b1ec98b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d6a85b9-efaf-402f-8634-bde0349d2a62', 'volume_name': 'volume-7d6a85b9-efaf-402f-8634-bde0349d2a62', 'volume_size': 2}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ccb387-b4b2-47d2-9d3e-4d40e87ee400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ccb387-b4b2-47d2-9d3e-4d40e87ee400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f334ebf-434e-4ecc-88af-42382865873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:10 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Volume 7d6a85b9-efaf-402f-8634-bde0349d2a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d6a85b9-efaf-402f-8634-bde0349d2a62', 'volume_size': 2} Aug 26 16:28:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:14 devstack sudo[113144]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70" returned: 0 in 4.117s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02, size 1024.00 MB, duration 4.12 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70 {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:28:14 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Converted 1024.00 MB image at 248.70 MB/s Aug 26 16:28:14 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70 is being set with open permissions: ugo+rw Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:14 devstack sudo[113158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70 Aug 26 16:28:14 devstack sudo[113158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:14 devstack sudo[113158]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70" returned: 0 in 0.242s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-quobyte-62ba4c55-b0a9-4be1-9987-3124d69cdf70" released by "_copy_volume_from_snapshot" :: held 5.230s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-quobyte-1a257889-c047-4108-943a-7e7292aacb9a-62ba4c55-b0a9-4be1-9987-3124d69cdf70" released by "_create_volume_from_snapshot" :: held 5.294s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.311s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.349s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-429091656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6a85b9-efaf-402f-8634-bde0349d2a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4192ce7b07ca4be5967663ac3670ce19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:28:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:28:10Z,use_quota=True,user_id='7784caf29125461096e588be3ac8c4ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Creating volume 7d6a85b9-efaf-402f-8634-bde0349d2a62 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:28:14 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 2147483648 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:14 devstack sudo[113161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 2147483648 Aug 26 16:28:14 devstack sudo[113161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f62ed39-94c3-483c-95a6-9b83e5ed15c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70', 'volume_size': 1, 'snapshot_id': '1a257889-c047-4108-943a-7e7292aacb9a'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0775ce-c9fb-4766-b595-19b59d2084ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:14 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Volume volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70 (62ba4c55-b0a9-4be1-9987-3124d69cdf70): created successfully Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0775ce-c9fb-4766-b595-19b59d2084ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Flow 'volume_create_manager' (115e4f98-7361-4b4f-a9f3-d03a14c80993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:14 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-aa3bd9ad-5077-4a8e-a8e6-53160bd087a0 tempest-SnapshotDependencyTests-861429089 None] Created volume successfully. Aug 26 16:28:15 devstack sudo[113161]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 2147483648" returned: 0 in 0.460s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:15 devstack sudo[113168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 Aug 26 16:28:15 devstack sudo[113168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:15 devstack sudo[113168]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62" returned: 0 in 0.234s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f334ebf-434e-4ecc-88af-42382865873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d6a85b9-efaf-402f-8634-bde0349d2a62', 'volume_size': 2}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4d9820-9955-4c4a-909b-2be1c0bac051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:15 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Volume volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 (7d6a85b9-efaf-402f-8634-bde0349d2a62): created successfully Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4d9820-9955-4c4a-909b-2be1c0bac051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Flow 'volume_create_manager' (d51603b4-f75f-4501-a19f-33084d38b4ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:15 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-17248d54-26c6-4a51-8508-917d3caa76e8 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Created volume successfully. Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "cinder-1a257889-c047-4108-943a-7e7292aacb9a-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-1a257889-c047-4108-943a-7e7292aacb9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "cinder-quobyte-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-quobyte-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "cinder-quobyte-1a257889-c047-4108-943a-7e7292aacb9a" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-quobyte-1a257889-c047-4108-943a-7e7292aacb9a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Deleting offline snapshot 1a257889-c047-4108-943a-7e7292aacb9a of volume 4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] snapshot_file for this snap is: volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e99b36-5c97-45cc-9cdd-ed5a17821853]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:15 devstack sudo[113171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a Aug 26 16:28:15 devstack sudo[113171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Creating offline snapshot 34de8767-dcef-4f38-af42-7e900997ac67 of volume 7d6a85b9-efaf-402f-8634-bde0349d2a62 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:28:16 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e5d8c4-cabf-4d02-80a4-99a2dc7268ab]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:16 devstack sudo[113173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 Aug 26 16:28:16 devstack sudo[113173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:16 devstack sudo[113171]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a" returned: 0 in 0.406s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:28:16 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eed39c-ba1c-4043-b849-9262d9187c83]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:16 devstack sudo[113178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 Aug 26 16:28:16 devstack sudo[113178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:16 devstack sudo[113173]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62" returned: 0 in 0.360s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 2G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:16 devstack sudo[113183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 2G Aug 26 16:28:16 devstack sudo[113183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:16 devstack sudo[113183]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 2G" returned: 0 in 0.390s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:16 devstack sudo[113191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 Aug 26 16:28:16 devstack sudo[113191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:16 devstack sudo[113178]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02" returned: 0 in 0.560s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:16 devstack sudo[113193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a Aug 26 16:28:16 devstack sudo[113193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:17 devstack sudo[113191]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67" returned: 0 in 0.294s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:17 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 is being set with open permissions: ugo+rw Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:17 devstack sudo[113202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 Aug 26 16:28:17 devstack sudo[113202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:17 devstack sudo[113193]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a" returned: 0 in 0.359s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:17 devstack sudo[113204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a Aug 26 16:28:17 devstack sudo[113204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:17 devstack sudo[113202]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67" returned: 0 in 0.253s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:17 devstack sudo[113207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.info Aug 26 16:28:17 devstack sudo[113207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:17 devstack sudo[113204]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02.1a257889-c047-4108-943a-7e7292aacb9a" returned: 0 in 0.254s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-quobyte-1a257889-c047-4108-943a-7e7292aacb9a" released by "_delete_snapshot" :: held 1.677s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-quobyte-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02" released by "delete_snapshot" :: held 1.704s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Created reservations ['d100f853-0e85-4b48-880f-dbc714a7924e', 'a86b5efe-aa82-4efc-bca1-40e6f4923ac6', 'ccd6980f-eddc-44b3-a0f6-15718730d5bc', 'bc4c38c3-cafc-46c1-9777-7ccfbbb0006a'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:17 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Delete snapshot completed successfully. Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd23272e-8fe9-44e6-90ff-430cbdd4a19b tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-1a257889-c047-4108-943a-7e7292aacb9a-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:17 devstack sudo[113207]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.info" returned: 0 in 0.253s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:17 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.info is being set with open permissions: ugo+rw Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:17 devstack sudo[113211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.info Aug 26 16:28:17 devstack sudo[113211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:17 devstack sudo[113211]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.info" returned: 0 in 0.242s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "cinder-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:17 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2a011c5c-174e-4c9b-9f72-5ba8cd2a59d3 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Create snapshot completed successfully Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "cinder-quobyte-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-quobyte-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8066ffb-2f3e-4fe9-b2a9-7754e99ebc86]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:18 devstack sudo[113214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:28:18 devstack sudo[113214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:18 devstack sudo[113215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 Aug 26 16:28:18 devstack sudo[113215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Acquiring lock "cinder-34de8767-dcef-4f38-af42-7e900997ac67-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "cinder-34de8767-dcef-4f38-af42-7e900997ac67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Acquiring lock "cinder-quobyte-7d6a85b9-efaf-402f-8634-bde0349d2a62" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "cinder-quobyte-7d6a85b9-efaf-402f-8634-bde0349d2a62" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Acquiring lock "cinder-quobyte-34de8767-dcef-4f38-af42-7e900997ac67" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "cinder-quobyte-34de8767-dcef-4f38-af42-7e900997ac67" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Deleting offline snapshot 34de8767-dcef-4f38-af42-7e900997ac67 of volume 7d6a85b9-efaf-402f-8634-bde0349d2a62 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] snapshot_file for this snap is: volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:28:18 devstack sudo[113214]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5368631-2647-4d9a-81b0-00ffd236517b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.271s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 29 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:28:18 devstack sudo[113219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 Aug 26 16:28:18 devstack sudo[113219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:18 devstack sudo[113215]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02" returned: 0 in 0.424s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:18 devstack sudo[113224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02 Aug 26 16:28:18 devstack sudo[113224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:18 devstack sudo[113219]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67" returned: 0 in 0.353s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d6a85b9-efaf-402f-8634-bde0349d2a62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[710b3863-26c1-49ea-9eb6-8d5f1e3fd642]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:18 devstack sudo[113224]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02" returned: 0 in 0.279s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-quobyte-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02" released by "delete_volume" :: held 0.767s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Created reservations ['b4f2c349-3faa-4826-86e2-5f5a56eaaad5', 'ac3aa40d-1e8f-4a39-94ff-5856fc4324f6', '11e5dd5d-72b5-47c8-9818-ea5b234e19cb', 'b677fd06-e0f1-4e13-8a67-43faf490309d'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:18 devstack sudo[113230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 Aug 26 16:28:18 devstack sudo[113230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:18 devstack sudo[113232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:28:18 devstack sudo[113232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:19 devstack sudo[113230]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "cinder-62ba4c55-b0a9-4be1-9987-3124d69cdf70-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62" returned: 0 in 0.393s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-62ba4c55-b0a9-4be1-9987-3124d69cdf70-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:19 devstack sudo[113238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 Aug 26 16:28:19 devstack sudo[113238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "cinder-quobyte-62ba4c55-b0a9-4be1-9987-3124d69cdf70" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:19 devstack sudo[113232]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.295s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-quobyte-62ba4c55-b0a9-4be1-9987-3124d69cdf70" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:19 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Deleted volume successfully. Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[957013c9-a101-4365-8139-3d0e05644942]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2b203770-1770-4e43-96db-1253b819cae4 tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-4f5e4ff8-9c0a-4b76-92be-c919e4a21f02-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:19 devstack sudo[113241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70 Aug 26 16:28:19 devstack sudo[113241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:19 devstack sudo[113238]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67" returned: 0 in 0.369s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:19 devstack sudo[113246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67 Aug 26 16:28:19 devstack sudo[113246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:19 devstack sudo[113241]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70" returned: 0 in 0.374s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:19 devstack sudo[113251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70 Aug 26 16:28:19 devstack sudo[113251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:19 devstack sudo[113246]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62.34de8767-dcef-4f38-af42-7e900997ac67" returned: 0 in 0.252s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "cinder-quobyte-34de8767-dcef-4f38-af42-7e900997ac67" released by "_delete_snapshot" :: held 1.499s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "cinder-quobyte-7d6a85b9-efaf-402f-8634-bde0349d2a62" released by "delete_snapshot" :: held 1.533s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Created reservations ['66ca1a72-333e-477b-a5d7-ad7ce506fcc3', '3551d2af-f534-4050-99b4-f68e38c08132', '0e910397-ae3b-4766-8c7b-ab087babda20', '2410afce-3157-4ebe-8ff0-568e7f8b0560'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:19 devstack sudo[113251]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-62ba4c55-b0a9-4be1-9987-3124d69cdf70" returned: 0 in 0.262s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-quobyte-62ba4c55-b0a9-4be1-9987-3124d69cdf70" released by "delete_volume" :: held 0.686s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:19 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Delete snapshot completed successfully. Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7b4b1ed0-69ee-4978-98ec-e7eab91f8f75 tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "cinder-34de8767-dcef-4f38-af42-7e900997ac67-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Created reservations ['29804394-7b96-4c87-bdd4-2333f8fa268b', '966aa9b1-00f8-4751-afc4-afd978da62e6', 'f4fa525e-3b6a-4611-90f5-1b6fef93e8df', 'c3301224-89d0-4282-9c62-f12d3035de28'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:19 devstack sudo[113255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:28:19 devstack sudo[113255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:20 devstack sudo[113255]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.237s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:20 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:28:20 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Deleted volume successfully. Aug 26 16:28:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-951e9ad3-00c8-4d4a-ac6b-305ed513568f tempest-SnapshotDependencyTests-861429089 None] Lock "cinder-62ba4c55-b0a9-4be1-9987-3124d69cdf70-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Acquiring lock "cinder-7d6a85b9-efaf-402f-8634-bde0349d2a62-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "cinder-7d6a85b9-efaf-402f-8634-bde0349d2a62-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Acquiring lock "cinder-quobyte-7d6a85b9-efaf-402f-8634-bde0349d2a62" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "cinder-quobyte-7d6a85b9-efaf-402f-8634-bde0349d2a62" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:20 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[06621369-7bbb-499e-9084-e0e8ac11dbc8]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:20 devstack sudo[113258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 Aug 26 16:28:20 devstack sudo[113258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:20 devstack sudo[113258]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62" returned: 0 in 0.351s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:20 devstack sudo[113263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62 Aug 26 16:28:20 devstack sudo[113263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:21 devstack sudo[113263]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d6a85b9-efaf-402f-8634-bde0349d2a62" returned: 0 in 0.270s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "cinder-quobyte-7d6a85b9-efaf-402f-8634-bde0349d2a62" released by "delete_volume" :: held 0.688s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:21 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Created reservations ['4d6ca0bf-463a-490d-85cc-5020c4b57b05', '282f4172-46bb-4e87-baf7-9d1a6fbc2cf5', '130cc39c-6018-4874-9373-150fbae13b89', 'dd2064d6-15ee-4f47-b2cc-5950d7e7d3cf'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:21 devstack sudo[113266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:28:21 devstack sudo[113266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:21 devstack sudo[113266]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.269s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:21 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:28:21 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Deleted volume successfully. Aug 26 16:28:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-25e2cf57-be8c-4fac-99ff-abb0653cc5ef tempest-VolumesSnapshotNegativeTestJSON-1281259123 None] Lock "cinder-7d6a85b9-efaf-402f-8634-bde0349d2a62-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Flow 'volume_create_manager' (ff790b56-ec0a-48b5-a786-a2ac6fc5dd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a25a2ec-1330-41c6-b7ca-fd8eb54f61a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a25a2ec-1330-41c6-b7ca-fd8eb54f61a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1209657510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d0212d-f63b-43ae-be96-6a39c42b6eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dd747ebdd14cdaaf0389a408531aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:28:25Z,use_quota=True,user_id='4689dd73f4574ff1b6e37d375d448f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e6a1a5-db1b-4f60-b82f-2abf2b5561f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e6a1a5-db1b-4f60-b82f-2abf2b5561f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f34a325-cd75-47c9-8998-812f9c4bb34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f34a325-cd75-47c9-8998-812f9c4bb34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d0212d-f63b-43ae-be96-6a39c42b6eb5', 'volume_name': 'volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cd55f8-4de0-4505-a138-1ffead67c909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cd55f8-4de0-4505-a138-1ffead67c909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c65136d-cc45-4021-9306-9a73a3460d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:24 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Volume a4d0212d-f63b-43ae-be96-6a39c42b6eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5', 'volume_size': 1} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1209657510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d0212d-f63b-43ae-be96-6a39c42b6eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dd747ebdd14cdaaf0389a408531aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:28:25Z,use_quota=True,user_id='4689dd73f4574ff1b6e37d375d448f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Creating volume a4d0212d-f63b-43ae-be96-6a39c42b6eb5 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:28:24 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:28:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:24 devstack sudo[113273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 1073741824 Aug 26 16:28:24 devstack sudo[113273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:25 devstack sudo[113273]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 1073741824" returned: 0 in 0.445s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:25 devstack sudo[113279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 Aug 26 16:28:25 devstack sudo[113279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:25 devstack sudo[113279]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5" returned: 0 in 0.253s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:28:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c65136d-cc45-4021-9306-9a73a3460d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7a81ad-bae1-48f7-9052-c56e1950c31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:25 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Volume volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 (a4d0212d-f63b-43ae-be96-6a39c42b6eb5): created successfully Aug 26 16:28:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7a81ad-bae1-48f7-9052-c56e1950c31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:25 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Flow 'volume_create_manager' (ff790b56-ec0a-48b5-a786-a2ac6fc5dd96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:25 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-30f2087d-96db-4488-a72d-512b24f24860 tempest-VolumeDependencyTests-1459533036 None] Created volume successfully. Aug 26 16:28:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:26 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] Creating offline snapshot d3b0d58c-91de-4ffa-a1be-6def863aae86 of volume a4d0212d-f63b-43ae-be96-6a39c42b6eb5 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:28:26 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ed9491-0ce3-4901-bf1c-65b793404634]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:26 devstack sudo[113283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 Aug 26 16:28:26 devstack sudo[113283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:27 devstack sudo[113283]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5" returned: 0 in 0.347s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:27 devstack sudo[113288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 1G Aug 26 16:28:27 devstack sudo[113288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:27 devstack sudo[113288]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 1G" returned: 0 in 0.400s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:27 devstack sudo[113293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 Aug 26 16:28:27 devstack sudo[113293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:27 devstack sudo[113293]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86" returned: 0 in 0.333s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:27 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 is being set with open permissions: ugo+rw Aug 26 16:28:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:27 devstack sudo[113299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 Aug 26 16:28:27 devstack sudo[113299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:28 devstack sudo[113299]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86" returned: 0 in 0.239s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:28 devstack sudo[113302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.info Aug 26 16:28:28 devstack sudo[113302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:28 devstack sudo[113302]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.info" returned: 0 in 0.256s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:28 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.info is being set with open permissions: ugo+rw Aug 26 16:28:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:28 devstack sudo[113306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.info Aug 26 16:28:28 devstack sudo[113306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:28 devstack sudo[113306]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.info" returned: 0 in 0.248s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:28 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-71298413-9f7a-4e2c-8c48-e40b2fb41a1e tempest-VolumeDependencyTests-1459533036 None] Create snapshot completed successfully Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Flow 'volume_create_manager' (b24a4bfc-2100-4a78-9154-81c87cb63caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ec15d9-95c7-45b4-880d-5fb91b124413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ec15d9-95c7-45b4-880d-5fb91b124413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1429301294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79a453d-656a-43ef-bdc4-b405dcb564ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10dd747ebdd14cdaaf0389a408531aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d3b0d58c-91de-4ffa-a1be-6def863aae86,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:28:29Z,use_quota=True,user_id='4689dd73f4574ff1b6e37d375d448f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1c75a3-ffe2-4f46-8324-cb344f7e2b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1c75a3-ffe2-4f46-8324-cb344f7e2b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9921f4b1-32d3-4382-ac41-566b118de016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9921f4b1-32d3-4382-ac41-566b118de016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f79a453d-656a-43ef-bdc4-b405dcb564ff', 'volume_name': 'volume-f79a453d-656a-43ef-bdc4-b405dcb564ff', 'volume_size': 1, 'snapshot_id': 'd3b0d58c-91de-4ffa-a1be-6def863aae86'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e2f59a-ab20-45df-8e9d-ec4dfd1fc5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e2f59a-ab20-45df-8e9d-ec4dfd1fc5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a507ff23-4aca-4e27-b8b3-0cdba92fe75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:29 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Volume f79a453d-656a-43ef-bdc4-b405dcb564ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f79a453d-656a-43ef-bdc4-b405dcb564ff', 'volume_size': 1, 'snapshot_id': 'd3b0d58c-91de-4ffa-a1be-6def863aae86'} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "cinder-quobyte-d3b0d58c-91de-4ffa-a1be-6def863aae86-f79a453d-656a-43ef-bdc4-b405dcb564ff" by "_create_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-quobyte-d3b0d58c-91de-4ffa-a1be-6def863aae86-f79a453d-656a-43ef-bdc4-b405dcb564ff" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Creating volume f79a453d-656a-43ef-bdc4-b405dcb564ff from snapshot d3b0d58c-91de-4ffa-a1be-6def863aae86 {{(pid=94407) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "cinder-quobyte-f79a453d-656a-43ef-bdc4-b405dcb564ff" by "_copy_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-quobyte-f79a453d-656a-43ef-bdc4-b405dcb564ff" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] snapshot: d3b0d58c-91de-4ffa-a1be-6def863aae86, volume: f79a453d-656a-43ef-bdc4-b405dcb564ff, {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4df90cf-8202-4be8-ab61-584fd1a31acc]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:29 devstack sudo[113343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 Aug 26 16:28:29 devstack sudo[113343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:30 devstack sudo[113343]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86" returned: 0 in 0.400s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:28:30 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb8573b-4973-4994-986d-9493bd1955bd]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:30 devstack sudo[113350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 Aug 26 16:28:30 devstack sudo[113350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:30 devstack sudo[113350]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5" returned: 0 in 0.370s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] will copy from snapshot at /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 16:28:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Creating direct copy from snapshot {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 16:28:30 devstack cinder-volume[94407]: DEBUG cinder.utils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Path /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff not found in is_blk_device check {{(pid=94407) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 16:28:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:30 devstack sudo[113355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff Aug 26 16:28:30 devstack sudo[113355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:34 devstack sudo[113355]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff" returned: 0 in 4.031s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:34 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:28:34 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Converted 1024.00 MB image at 253.94 MB/s Aug 26 16:28:34 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff is being set with open permissions: ugo+rw Aug 26 16:28:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:34 devstack sudo[113369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff Aug 26 16:28:34 devstack sudo[113369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:34 devstack sudo[113369]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff" returned: 0 in 0.234s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-quobyte-f79a453d-656a-43ef-bdc4-b405dcb564ff" released by "_copy_volume_from_snapshot" :: held 5.125s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-quobyte-d3b0d58c-91de-4ffa-a1be-6def863aae86-f79a453d-656a-43ef-bdc4-b405dcb564ff" released by "_create_volume_from_snapshot" :: held 5.194s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.215s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a507ff23-4aca-4e27-b8b3-0cdba92fe75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79a453d-656a-43ef-bdc4-b405dcb564ff', 'volume_size': 1, 'snapshot_id': 'd3b0d58c-91de-4ffa-a1be-6def863aae86'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225297b3-0dae-492c-bdba-adcc7bb9ee13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:34 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Volume volume-f79a453d-656a-43ef-bdc4-b405dcb564ff (f79a453d-656a-43ef-bdc4-b405dcb564ff): created successfully Aug 26 16:28:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225297b3-0dae-492c-bdba-adcc7bb9ee13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:34 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Flow 'volume_create_manager' (b24a4bfc-2100-4a78-9154-81c87cb63caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:34 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-026448ca-11d0-4a5f-a710-082f9095e6b8 tempest-VolumeDependencyTests-1459533036 None] Created volume successfully. Aug 26 16:28:35 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "cinder-d3b0d58c-91de-4ffa-a1be-6def863aae86-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-d3b0d58c-91de-4ffa-a1be-6def863aae86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "cinder-quobyte-a4d0212d-f63b-43ae-be96-6a39c42b6eb5" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-quobyte-a4d0212d-f63b-43ae-be96-6a39c42b6eb5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "cinder-quobyte-d3b0d58c-91de-4ffa-a1be-6def863aae86" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-quobyte-d3b0d58c-91de-4ffa-a1be-6def863aae86" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Deleting offline snapshot d3b0d58c-91de-4ffa-a1be-6def863aae86 of volume a4d0212d-f63b-43ae-be96-6a39c42b6eb5 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] snapshot_file for this snap is: volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[669edc70-b228-4333-9fcf-7fb4010a3aa7]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:36 devstack sudo[113373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 Aug 26 16:28:36 devstack sudo[113373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:36 devstack sudo[113373]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86" returned: 0 in 0.344s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9835f0-6bf5-4df1-82ca-fd687b27cb19]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:36 devstack sudo[113384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 Aug 26 16:28:36 devstack sudo[113384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:36 devstack sudo[113384]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5" returned: 0 in 0.533s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:37 devstack sudo[113389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 Aug 26 16:28:37 devstack sudo[113389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:37 devstack sudo[113389]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86" returned: 0 in 0.319s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:37 devstack sudo[113395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86 Aug 26 16:28:37 devstack sudo[113395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:37 devstack sudo[113395]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5.d3b0d58c-91de-4ffa-a1be-6def863aae86" returned: 0 in 0.232s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:37 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-quobyte-d3b0d58c-91de-4ffa-a1be-6def863aae86" released by "_delete_snapshot" :: held 1.521s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:37 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-quobyte-a4d0212d-f63b-43ae-be96-6a39c42b6eb5" released by "delete_snapshot" :: held 1.548s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:37 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Created reservations ['85fe3837-3da8-40de-bb35-ea19932033c1', 'b5ad6af3-4f23-4cc9-b1cd-f4380456cf59', 'a909c80f-f357-44f6-a42c-32c2fde5aa95', '00852290-1282-47f6-ad72-aecac03bf273'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Delete snapshot completed successfully. Aug 26 16:28:37 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bd3576a3-95ef-49bd-9722-879e6a006990 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-d3b0d58c-91de-4ffa-a1be-6def863aae86-delete_snapshot" released by "delete_snapshot" :: held 1.675s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "cinder-a4d0212d-f63b-43ae-be96-6a39c42b6eb5-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-a4d0212d-f63b-43ae-be96-6a39c42b6eb5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "cinder-quobyte-a4d0212d-f63b-43ae-be96-6a39c42b6eb5" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-quobyte-a4d0212d-f63b-43ae-be96-6a39c42b6eb5" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:38 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ce2a8a-6e79-44e7-a2ed-bae9c431d0dd]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:38 devstack sudo[113398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 Aug 26 16:28:38 devstack sudo[113398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:38 devstack sudo[113398]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5" returned: 0 in 0.353s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:38 devstack sudo[113403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5 Aug 26 16:28:38 devstack sudo[113403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:38 devstack sudo[113403]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-a4d0212d-f63b-43ae-be96-6a39c42b6eb5" returned: 0 in 0.253s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-quobyte-a4d0212d-f63b-43ae-be96-6a39c42b6eb5" released by "delete_volume" :: held 0.662s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:38 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Created reservations ['2958116a-521f-4962-b3ac-8c3979ecc856', '9e8ae612-8e90-4d0f-b83e-5d149ba077ad', '1207c0de-d957-4276-85ad-0a179b7d4739', '274b86fa-82fb-42a4-b083-59997b8c07ee'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:39 devstack sudo[113406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:28:39 devstack sudo[113406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:39 devstack sudo[113406]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.238s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:28:39 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Deleted volume successfully. Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-833d3219-cc10-428c-8608-a4eba883b2cc tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-a4d0212d-f63b-43ae-be96-6a39c42b6eb5-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "cinder-f79a453d-656a-43ef-bdc4-b405dcb564ff-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-f79a453d-656a-43ef-bdc4-b405dcb564ff-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "cinder-quobyte-f79a453d-656a-43ef-bdc4-b405dcb564ff" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-quobyte-f79a453d-656a-43ef-bdc4-b405dcb564ff" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31b28b3-edcd-4f94-87ca-ef459808e4e1]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:39 devstack sudo[113409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff Aug 26 16:28:39 devstack sudo[113409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:39 devstack sudo[113409]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff" returned: 0 in 0.337s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:39 devstack sudo[113414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff Aug 26 16:28:39 devstack sudo[113414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:40 devstack sudo[113414]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a453d-656a-43ef-bdc4-b405dcb564ff" returned: 0 in 0.246s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-quobyte-f79a453d-656a-43ef-bdc4-b405dcb564ff" released by "delete_volume" :: held 0.620s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:40 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Created reservations ['9f4b8607-8ff4-4ebf-b1a0-a828eb239646', 'e7e74198-a56c-4887-b2e8-96ad1b0696ab', '4b836dcd-78f5-44ed-b7a4-02c5e9b94595', '81cd7e5d-bdb6-4a70-98ef-bc8d225ff880'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:40 devstack sudo[113417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:28:40 devstack sudo[113417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:40 devstack sudo[113417]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.243s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:40 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:28:40 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Deleted volume successfully. Aug 26 16:28:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-81cb8f79-b461-4bf1-9a74-23b0a537b250 tempest-VolumeDependencyTests-1459533036 None] Lock "cinder-f79a453d-656a-43ef-bdc4-b405dcb564ff-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:43 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Flow 'volume_create_manager' (6e16580f-930c-4d5f-a88f-d940d6775879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d9de56-0137-4a5f-89ac-e7c4cb1836ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d9de56-0137-4a5f-89ac-e7c4cb1836ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2057329765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6018996-dc66-4422-bbea-293d7f67e6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0de54abe494f7081a4018fa334c174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:28:44Z,use_quota=True,user_id='e6816074589946c09474793dc54fe67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6763faaa-ee63-4be2-929a-9ea4bd45bfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6763faaa-ee63-4be2-929a-9ea4bd45bfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1917d9-61ec-4bbf-a4d7-fcc43388f186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1917d9-61ec-4bbf-a4d7-fcc43388f186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6018996-dc66-4422-bbea-293d7f67e6d0', 'volume_name': 'volume-c6018996-dc66-4422-bbea-293d7f67e6d0', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922988bc-421f-4817-9100-c9ebd45a2f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922988bc-421f-4817-9100-c9ebd45a2f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d3037f-25ef-4a65-a84f-eb87319a8892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:44 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Volume c6018996-dc66-4422-bbea-293d7f67e6d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6018996-dc66-4422-bbea-293d7f67e6d0', 'volume_size': 1} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2057329765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6018996-dc66-4422-bbea-293d7f67e6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0de54abe494f7081a4018fa334c174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:28:44Z,use_quota=True,user_id='e6816074589946c09474793dc54fe67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Creating volume c6018996-dc66-4422-bbea-293d7f67e6d0 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:28:44 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c6018996-dc66-4422-bbea-293d7f67e6d0 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:44 devstack sudo[113421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c6018996-dc66-4422-bbea-293d7f67e6d0 1073741824 Aug 26 16:28:44 devstack sudo[113421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:44 devstack sudo[113421]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c6018996-dc66-4422-bbea-293d7f67e6d0 1073741824" returned: 0 in 0.403s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c6018996-dc66-4422-bbea-293d7f67e6d0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:44 devstack sudo[113428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c6018996-dc66-4422-bbea-293d7f67e6d0 Aug 26 16:28:44 devstack sudo[113428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:44 devstack sudo[113428]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c6018996-dc66-4422-bbea-293d7f67e6d0" returned: 0 in 0.241s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d3037f-25ef-4a65-a84f-eb87319a8892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6018996-dc66-4422-bbea-293d7f67e6d0', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e84c06-4a71-41a0-b10b-007252a28cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:44 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Volume volume-c6018996-dc66-4422-bbea-293d7f67e6d0 (c6018996-dc66-4422-bbea-293d7f67e6d0): created successfully Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e84c06-4a71-41a0-b10b-007252a28cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Flow 'volume_create_manager' (6e16580f-930c-4d5f-a88f-d940d6775879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:44 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a67efd3d-081e-46a6-bbd4-3660a6186cd1 tempest-ProjectReaderTests-1173372458 None] Created volume successfully. Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Acquiring lock "cinder-c6018996-dc66-4422-bbea-293d7f67e6d0-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Lock "cinder-c6018996-dc66-4422-bbea-293d7f67e6d0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Acquiring lock "cinder-quobyte-c6018996-dc66-4422-bbea-293d7f67e6d0" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Lock "cinder-quobyte-c6018996-dc66-4422-bbea-293d7f67e6d0" acquired by "delete_volume" :: waited 0.013s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5e92c4-1a58-4fbf-962d-149ccf97ba4b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c6018996-dc66-4422-bbea-293d7f67e6d0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:45 devstack sudo[113432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c6018996-dc66-4422-bbea-293d7f67e6d0 Aug 26 16:28:45 devstack sudo[113432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:45 devstack sudo[113432]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c6018996-dc66-4422-bbea-293d7f67e6d0" returned: 0 in 0.341s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c6018996-dc66-4422-bbea-293d7f67e6d0 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:45 devstack sudo[113437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c6018996-dc66-4422-bbea-293d7f67e6d0 Aug 26 16:28:45 devstack sudo[113437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:45 devstack sudo[113437]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-c6018996-dc66-4422-bbea-293d7f67e6d0" returned: 0 in 0.243s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Lock "cinder-quobyte-c6018996-dc66-4422-bbea-293d7f67e6d0" released by "delete_volume" :: held 0.622s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Created reservations ['479c475d-6d6c-4801-b284-955315462090', 'e9a706f0-23b0-4519-b74e-9925abe7d57c', '6bfe87d6-b7c4-4544-a482-4586e515c0a8', '8abfbd2f-9c0e-4de9-8e92-0746e2db313c'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:45 devstack sudo[113440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:28:45 devstack sudo[113440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:46 devstack sudo[113440]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.229s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:28:46 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Deleted volume successfully. Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cd405831-2c61-43b9-b817-dc0a9fc46464 tempest-ProjectReaderTests-1173372458 None] Lock "cinder-c6018996-dc66-4422-bbea-293d7f67e6d0-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Flow 'volume_create_manager' (15f13d45-6b34-43db-a24d-3c5f8a8ff054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2834a622-2b2d-4820-b448-693e88a96a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2834a622-2b2d-4820-b448-693e88a96a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172994113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c71f06-e9d2-4bdc-b32b-23a7c9dccb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0de54abe494f7081a4018fa334c174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:28:47Z,use_quota=True,user_id='e6816074589946c09474793dc54fe67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c846337d-b039-48c2-8151-b1057a242df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c846337d-b039-48c2-8151-b1057a242df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d31c1ad-fbc2-441b-8eca-eb3eeaf71af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d31c1ad-fbc2-441b-8eca-eb3eeaf71af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c71f06-e9d2-4bdc-b32b-23a7c9dccb26', 'volume_name': 'volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a765f4b0-fe5c-4878-8bab-29791d94c26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a765f4b0-fe5c-4878-8bab-29791d94c26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857775c8-305d-4001-9258-446d8703b2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:46 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Volume 23c71f06-e9d2-4bdc-b32b-23a7c9dccb26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26', 'volume_size': 1} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172994113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c71f06-e9d2-4bdc-b32b-23a7c9dccb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0de54abe494f7081a4018fa334c174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:28:47Z,use_quota=True,user_id='e6816074589946c09474793dc54fe67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Creating volume 23c71f06-e9d2-4bdc-b32b-23a7c9dccb26 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:28:46 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:28:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:46 devstack sudo[113443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26 1073741824 Aug 26 16:28:46 devstack sudo[113443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:47 devstack sudo[113443]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26 1073741824" returned: 0 in 0.421s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:47 devstack sudo[113449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26 Aug 26 16:28:47 devstack sudo[113449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:47 devstack sudo[113449]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26" returned: 0 in 0.227s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857775c8-305d-4001-9258-446d8703b2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71fb7cd-768d-4bef-80d0-f170294216b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:28:47 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Volume volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26 (23c71f06-e9d2-4bdc-b32b-23a7c9dccb26): created successfully Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71fb7cd-768d-4bef-80d0-f170294216b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Flow 'volume_create_manager' (15f13d45-6b34-43db-a24d-3c5f8a8ff054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:28:47 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ebe3f0c0-5811-412b-9bd5-85c01b1943c9 tempest-ProjectReaderTests-1173372458 None] Created volume successfully. Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Acquiring lock "cinder-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Lock "cinder-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Acquiring lock "cinder-quobyte-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Lock "cinder-quobyte-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26" acquired by "delete_volume" :: waited 0.016s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b3aa91-73a8-412f-9ab1-556318675b63]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:28:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:47 devstack sudo[113452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26 Aug 26 16:28:47 devstack sudo[113452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:48 devstack sudo[113452]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26" returned: 0 in 0.335s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:48 devstack sudo[113457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26 Aug 26 16:28:48 devstack sudo[113457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:48 devstack sudo[113457]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26" returned: 0 in 0.230s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Lock "cinder-quobyte-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26" released by "delete_volume" :: held 0.598s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Created reservations ['11f066e3-9cb0-4217-9dcc-edce089f5270', '2c0e0602-f64e-4b2e-91fe-36f70f5f889b', '3b2f0fa1-3879-495b-a4d9-9173ca464e9a', '5de76600-a58d-495c-9c2c-b5d7bff449fd'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:28:48 devstack sudo[113460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:28:48 devstack sudo[113460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:28:48 devstack sudo[113460]: pam_unix(sudo:session): session closed for user root Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.229s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:28:48 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Deleted volume successfully. Aug 26 16:28:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50d71030-f2c9-45fe-b455-789199a85ef0 tempest-ProjectReaderTests-1173372458 None] Lock "cinder-23c71f06-e9d2-4bdc-b32b-23a7c9dccb26-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:28:58 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:DELETE=12,cinder:SELECT=105,cinder:UPDATE=118,cinder:INSERT=34 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:28:58 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=132,cinder:SELECT=103,cinder:DELETE=9,cinder:INSERT=32 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:29:00 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Flow 'volume_create_manager' (412584df-a49d-4f51-a7f9-534c678d513d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc3f8d4-ccc4-4f5d-967f-4b1cdb035f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc3f8d4-ccc4-4f5d-967f-4b1cdb035f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1529561495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d788e49-adf7-4c59-b40e-a694d7799b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33279950794746aa99ee737b6f3c4e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:01Z,use_quota=True,user_id='22a12cddb7d64bf8a77e6b9999402cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40965bc1-bda4-48ca-9b1c-3efec79353a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40965bc1-bda4-48ca-9b1c-3efec79353a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de0eb8a-96a1-4600-a09e-3a12f0eac3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de0eb8a-96a1-4600-a09e-3a12f0eac3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d788e49-adf7-4c59-b40e-a694d7799b6c', 'volume_name': 'volume-8d788e49-adf7-4c59-b40e-a694d7799b6c', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17598e8-00e4-4c8b-9a04-9343d596e5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17598e8-00e4-4c8b-9a04-9343d596e5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf597aa-8c25-46cf-a4c8-1e5565b30e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume 8d788e49-adf7-4c59-b40e-a694d7799b6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d788e49-adf7-4c59-b40e-a694d7799b6c', 'volume_size': 1} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1529561495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d788e49-adf7-4c59-b40e-a694d7799b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33279950794746aa99ee737b6f3c4e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:01Z,use_quota=True,user_id='22a12cddb7d64bf8a77e6b9999402cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Creating volume 8d788e49-adf7-4c59-b40e-a694d7799b6c {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:01 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:01 devstack sudo[113500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c 1073741824 Aug 26 16:29:01 devstack sudo[113500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Flow 'volume_create_manager' (1680cb47-0e0c-48fb-a38d-6456e6e3aa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3a491a-3024-4dfe-b689-4500a211e176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3a491a-3024-4dfe-b689-4500a211e176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1783354171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85af9250ccd40e39c75899b1f0f2920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:01Z,use_quota=True,user_id='7103a6f45d104b0f90879db1a9f76c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb075345-baec-436c-b5dd-a07aa6382ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb075345-baec-436c-b5dd-a07aa6382ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb08f74-7c0d-4daa-9c4a-8422389d49d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb08f74-7c0d-4daa-9c4a-8422389d49d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5', 'volume_name': 'volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6278f3-bf81-4156-a2c0-c90e22a3df9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6278f3-bf81-4156-a2c0-c90e22a3df9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eec6bc5-4f9d-496b-a862-424f9d94d707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Volume 9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5', 'volume_size': 1} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Flow 'volume_create_manager' (5ee48ca2-a3a0-4529-9f3e-29e6414011a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0067e767-424f-4e8a-abe8-253e7cbb8e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0067e767-424f-4e8a-abe8-253e7cbb8e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433010616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934e394b-e241-4ee9-bfc6-eef5f95968ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85af9250ccd40e39c75899b1f0f2920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:01Z,use_quota=True,user_id='7103a6f45d104b0f90879db1a9f76c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c44ee9-755e-43f0-9f5c-f7c9e190999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c44ee9-755e-43f0-9f5c-f7c9e190999c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957090bf-04aa-415d-bd72-701bd7eb99d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957090bf-04aa-415d-bd72-701bd7eb99d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '934e394b-e241-4ee9-bfc6-eef5f95968ed', 'volume_name': 'volume-934e394b-e241-4ee9-bfc6-eef5f95968ed', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d537e4d-389e-49b7-8399-756837cd672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d537e4d-389e-49b7-8399-756837cd672e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5234b0a1-6c21-4a99-a34e-3afbfd75a794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Volume 934e394b-e241-4ee9-bfc6-eef5f95968ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-934e394b-e241-4ee9-bfc6-eef5f95968ed', 'volume_size': 1} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Flow 'volume_create_manager' (14bcfa74-e3bf-45bc-97e9-6a4f01b09741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1942e3dd-fe21-4f55-a7f5-6e1737941da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack sudo[113500]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c 1073741824" returned: 0 in 0.735s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1942e3dd-fe21-4f55-a7f5-6e1737941da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-380738727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030a3f6a-fdf4-42fe-a62e-60ca590dae7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85af9250ccd40e39c75899b1f0f2920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:02Z,use_quota=True,user_id='7103a6f45d104b0f90879db1a9f76c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92c14a1-7d70-4b07-a632-9260e7d0ab5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92c14a1-7d70-4b07-a632-9260e7d0ab5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987f00cd-91e0-401e-90f0-b06aeb7a6891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987f00cd-91e0-401e-90f0-b06aeb7a6891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '030a3f6a-fdf4-42fe-a62e-60ca590dae7a', 'volume_name': 'volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7aca06e-26cc-4598-9162-5f03e25bbd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7aca06e-26cc-4598-9162-5f03e25bbd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe32c2a-1199-4361-a597-398df31eabef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Volume 030a3f6a-fdf4-42fe-a62e-60ca590dae7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a', 'volume_size': 1} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:02 devstack sudo[113506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c Aug 26 16:29:02 devstack sudo[113506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Flow 'volume_create_manager' (1795e220-fc96-4430-ae44-85e64af0e5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ae4b27-0ec7-4d67-8b88-0999b92ac22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ae4b27-0ec7-4d67-8b88-0999b92ac22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1029910503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf91adb9-4db6-49ab-ba66-6608b180f6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85af9250ccd40e39c75899b1f0f2920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:02Z,use_quota=True,user_id='7103a6f45d104b0f90879db1a9f76c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9cd899-de91-4605-8b16-03b5658120e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9cd899-de91-4605-8b16-03b5658120e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b2e1b0-570e-4607-ba8a-0740129f8199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b2e1b0-570e-4607-ba8a-0740129f8199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf91adb9-4db6-49ab-ba66-6608b180f6f4', 'volume_name': 'volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca808bb-94c5-43f3-a4d6-e4b96c1b83cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca808bb-94c5-43f3-a4d6-e4b96c1b83cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:02 devstack sudo[113506]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfabff98-4360-4a1b-80e6-4792cb360f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Volume bf91adb9-4db6-49ab-ba66-6608b180f6f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4', 'volume_size': 1} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c" returned: 0 in 0.332s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.072s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1783354171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85af9250ccd40e39c75899b1f0f2920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:01Z,use_quota=True,user_id='7103a6f45d104b0f90879db1a9f76c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Creating volume 9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:02 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf597aa-8c25-46cf-a4c8-1e5565b30e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d788e49-adf7-4c59-b40e-a694d7799b6c', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8099bc-e4fc-4842-a726-960b96ea6ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack sudo[113509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5 1073741824 Aug 26 16:29:02 devstack sudo[113509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:02 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume volume-8d788e49-adf7-4c59-b40e-a694d7799b6c (8d788e49-adf7-4c59-b40e-a694d7799b6c): created successfully Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8099bc-e4fc-4842-a726-960b96ea6ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Flow 'volume_create_manager' (412584df-a49d-4f51-a7f9-534c678d513d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:02 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7ce0e580-f000-492b-b2e1-965154750b19 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Created volume successfully. Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Flow 'volume_create_manager' (f3d6e1ba-7e3b-4563-9dea-3f159b456da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78c0e57-6f86-4981-8496-5b0b85795f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78c0e57-6f86-4981-8496-5b0b85795f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1176363550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85af9250ccd40e39c75899b1f0f2920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:03Z,use_quota=True,user_id='7103a6f45d104b0f90879db1a9f76c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1efea7-bea1-42e4-9258-5042a5c7137c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1efea7-bea1-42e4-9258-5042a5c7137c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0c7d02-8d55-4a2c-b8a5-63241d76c586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0c7d02-8d55-4a2c-b8a5-63241d76c586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387', 'volume_name': 'volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d7c2c4-a33c-415b-ad7d-b61cdf9fb076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d7c2c4-a33c-415b-ad7d-b61cdf9fb076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11aaac53-8f48-477f-acee-a720ce3bf932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:02 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Volume e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387', 'volume_size': 1} Aug 26 16:29:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:03 devstack sudo[113509]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5 1073741824" returned: 0 in 0.663s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:03 devstack sudo[113515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5 Aug 26 16:29:03 devstack sudo[113515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:03 devstack sudo[113515]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5" returned: 0 in 0.264s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.923s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433010616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934e394b-e241-4ee9-bfc6-eef5f95968ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85af9250ccd40e39c75899b1f0f2920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:01Z,use_quota=True,user_id='7103a6f45d104b0f90879db1a9f76c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Creating volume 934e394b-e241-4ee9-bfc6-eef5f95968ed {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:03 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-934e394b-e241-4ee9-bfc6-eef5f95968ed 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eec6bc5-4f9d-496b-a862-424f9d94d707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f355f69-a132-40c4-9db2-8a2c885b54e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:03 devstack sudo[113518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-934e394b-e241-4ee9-bfc6-eef5f95968ed 1073741824 Aug 26 16:29:03 devstack sudo[113518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:03 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Volume volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5 (9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5): created successfully Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f355f69-a132-40c4-9db2-8a2c885b54e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Flow 'volume_create_manager' (1680cb47-0e0c-48fb-a38d-6456e6e3aa05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:03 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-858c14c1-e4a5-491b-8ea9-30dad23d266a tempest-CreateVolumesFromImageTest-1369843917 None] Created volume successfully. Aug 26 16:29:03 devstack sudo[113518]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-934e394b-e241-4ee9-bfc6-eef5f95968ed 1073741824" returned: 0 in 0.515s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-934e394b-e241-4ee9-bfc6-eef5f95968ed {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:04 devstack sudo[113524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-934e394b-e241-4ee9-bfc6-eef5f95968ed Aug 26 16:29:04 devstack sudo[113524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:04 devstack sudo[113524]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-934e394b-e241-4ee9-bfc6-eef5f95968ed" returned: 0 in 0.281s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.273s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-380738727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030a3f6a-fdf4-42fe-a62e-60ca590dae7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85af9250ccd40e39c75899b1f0f2920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:02Z,use_quota=True,user_id='7103a6f45d104b0f90879db1a9f76c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Creating volume 030a3f6a-fdf4-42fe-a62e-60ca590dae7a {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:04 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5234b0a1-6c21-4a99-a34e-3afbfd75a794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-934e394b-e241-4ee9-bfc6-eef5f95968ed', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2c821e-faa9-4d85-b943-054b959e9cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:04 devstack sudo[113527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a 1073741824 Aug 26 16:29:04 devstack sudo[113527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:04 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Volume volume-934e394b-e241-4ee9-bfc6-eef5f95968ed (934e394b-e241-4ee9-bfc6-eef5f95968ed): created successfully Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2c821e-faa9-4d85-b943-054b959e9cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Flow 'volume_create_manager' (5ee48ca2-a3a0-4529-9f3e-29e6414011a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:04 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-582f181a-5d5f-4e31-a693-b95307b8535e tempest-CreateVolumesFromImageTest-1369843917 None] Created volume successfully. Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Flow 'volume_create_manager' (9216384d-c40b-42d3-9ccb-da9128e19d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a080a11-a919-4cbd-8b23-6844214a75d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a080a11-a919-4cbd-8b23-6844214a75d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6245e177-3ec6-42ca-ab7c-2f05617430e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1bb8eb4282949a39cfbc43f2402470c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:05Z,use_quota=True,user_id='4607049ff4ec456282a5d2dcdcd9e3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a8c573-0cf7-48b0-b66e-fe63d4fe61c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a8c573-0cf7-48b0-b66e-fe63d4fe61c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8e8607-b8ea-4349-9cd1-5958202fed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.image.glance [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Creating Keystone auth plugin from conf {{(pid=94407) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 16:29:04 devstack sudo[113527]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a 1073741824" returned: 0 in 0.549s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8e8607-b8ea-4349-9cd1-5958202fed21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6245e177-3ec6-42ca-ab7c-2f05617430e3', 'volume_name': 'volume-6245e177-3ec6-42ca-ab7c-2f05617430e3', 'volume_size': 1, 'image_id': '92fdc8a0-33fe-4280-9469-2ce7b2bb204d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92fdc8a0-33fe-4280-9469-2ce7b2bb204d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5d23f6a5eaa0382b3a20a8941add4d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1bb8eb4282949a39cfbc43f2402470c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '264d32a3c263ef3d1f27621a5c20dfe6c1ec5b7e39bc615430cf8a8aae1c8fed40ade81da696ae033621dca32396528741dc8d791f6b2c149105cf701ec7d0f6', 'id': '92fdc8a0-33fe-4280-9469-2ce7b2bb204d', 'created_at': datetime.datetime(2026, 8, 26, 14, 29, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 29, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92fdc8a0-33fe-4280-9469-2ce7b2bb204d/file', 'properties': {}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8cb4eca-2fc6-4314-ad61-67dab428f3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8cb4eca-2fc6-4314-ad61-67dab428f3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85948ed1-53a1-4e77-aa90-aa62d4e04de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:04 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Volume 6245e177-3ec6-42ca-ab7c-2f05617430e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6245e177-3ec6-42ca-ab7c-2f05617430e3', 'volume_size': 1, 'image_id': '92fdc8a0-33fe-4280-9469-2ce7b2bb204d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92fdc8a0-33fe-4280-9469-2ce7b2bb204d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5d23f6a5eaa0382b3a20a8941add4d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1bb8eb4282949a39cfbc43f2402470c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '264d32a3c263ef3d1f27621a5c20dfe6c1ec5b7e39bc615430cf8a8aae1c8fed40ade81da696ae033621dca32396528741dc8d791f6b2c149105cf701ec7d0f6', 'id': '92fdc8a0-33fe-4280-9469-2ce7b2bb204d', 'created_at': datetime.datetime(2026, 8, 26, 14, 29, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 29, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92fdc8a0-33fe-4280-9469-2ce7b2bb204d/file', 'properties': {}}, 'image_service': } Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Trying to clone 6245e177-3ec6-42ca-ab7c-2f05617430e3 from image 92fdc8a0-33fe-4280-9469-2ce7b2bb204d at location (None, [{'url': 'file:///opt/stack/data/glance/images/92fdc8a0-33fe-4280-9469-2ce7b2bb204d', 'metadata': {}}]). {{(pid=94407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 16:29:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:05 devstack sudo[113534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a Aug 26 16:29:05 devstack sudo[113534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 16:29:05 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Image download 0.00 MB at 0.00 MB/s Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f481b1c6-39fb-4ef3-848e-d48547f1f681]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:05 devstack sudo[113536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD Aug 26 16:29:05 devstack sudo[113536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:05 devstack sudo[113534]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a" returned: 0 in 0.289s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.797s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1029910503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf91adb9-4db6-49ab-ba66-6608b180f6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85af9250ccd40e39c75899b1f0f2920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:02Z,use_quota=True,user_id='7103a6f45d104b0f90879db1a9f76c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Creating volume bf91adb9-4db6-49ab-ba66-6608b180f6f4 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:05 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe32c2a-1199-4361-a597-398df31eabef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480f74f6-aa69-4609-8644-186d296e4aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:05 devstack sudo[113539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4 1073741824 Aug 26 16:29:05 devstack sudo[113539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:05 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Volume volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a (030a3f6a-fdf4-42fe-a62e-60ca590dae7a): created successfully Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480f74f6-aa69-4609-8644-186d296e4aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Flow 'volume_create_manager' (14bcfa74-e3bf-45bc-97e9-6a4f01b09741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:05 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2a3977ee-ff35-44a5-bf16-12d51e7227dc tempest-CreateVolumesFromImageTest-1369843917 None] Created volume successfully. Aug 26 16:29:05 devstack sudo[113536]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:05 devstack sudo[113543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD Aug 26 16:29:05 devstack sudo[113543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:05 devstack sudo[113539]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4 1073741824" returned: 0 in 0.475s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Flow 'volume_create_manager' (e03a447a-36d4-476a-b86e-377e5638f220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc57578-6fcf-4431-b17c-6c117146e69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc57578-6fcf-4431-b17c-6c117146e69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f585ce-557a-41e4-bac6-dd5218cfa80b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04759b3aa8347828a5d5805d9f259ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:06Z,use_quota=True,user_id='8417c84dff9548c3844265b4b446e25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2738b47-8ab4-4bfa-8c0f-181082a9561d),volume_type_id=d2738b47-8ab4-4bfa-8c0f-181082a9561d)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0923bc-9539-4cef-947d-5c912396e356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0923bc-9539-4cef-947d-5c912396e356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751cc499-a1b3-4102-9ca9-bca012447adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.image.glance [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Creating Keystone auth plugin from conf {{(pid=94407) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:05 devstack sudo[113552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4 Aug 26 16:29:05 devstack sudo[113552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:05 devstack sudo[113543]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Temporary image 92fdc8a0-33fe-4280-9469-2ce7b2bb204d is fetched for user 4607049ff4ec456282a5d2dcdcd9e3b0. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa699594-729a-4f47-b82d-060783653f8f]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:06 devstack sudo[113554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD Aug 26 16:29:06 devstack sudo[113554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:06 devstack sudo[113552]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751cc499-a1b3-4102-9ca9-bca012447adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86f585ce-557a-41e4-bac6-dd5218cfa80b', 'volume_name': 'volume-86f585ce-557a-41e4-bac6-dd5218cfa80b', 'volume_size': 1, 'image_id': '31af6675-704a-43bb-ba2b-df8f937acc30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/31af6675-704a-43bb-ba2b-df8f937acc30', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37ef66e438177f6e7482be67914b7d7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b04759b3aa8347828a5d5805d9f259ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '413effba996be20a1f65e0a5ba75ddaf6c6944724ccd9c79c2b347a8a2daf02db732a21666082536e6bc68fd6c5aaa73d728abac3eb936933c72eb330b52fc6b', 'id': '31af6675-704a-43bb-ba2b-df8f937acc30', 'created_at': datetime.datetime(2026, 8, 26, 14, 29, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 29, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/31af6675-704a-43bb-ba2b-df8f937acc30/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e787176f-bef6-4067-8c42-8345677ac3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e787176f-bef6-4067-8c42-8345677ac3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf618fb-c320-47be-a971-4f32cb4ba260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:06 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Volume 86f585ce-557a-41e4-bac6-dd5218cfa80b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86f585ce-557a-41e4-bac6-dd5218cfa80b', 'volume_size': 1, 'image_id': '31af6675-704a-43bb-ba2b-df8f937acc30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/31af6675-704a-43bb-ba2b-df8f937acc30', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37ef66e438177f6e7482be67914b7d7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b04759b3aa8347828a5d5805d9f259ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '413effba996be20a1f65e0a5ba75ddaf6c6944724ccd9c79c2b347a8a2daf02db732a21666082536e6bc68fd6c5aaa73d728abac3eb936933c72eb330b52fc6b', 'id': '31af6675-704a-43bb-ba2b-df8f937acc30', 'created_at': datetime.datetime(2026, 8, 26, 14, 29, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 29, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/31af6675-704a-43bb-ba2b-df8f937acc30/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Trying to clone 86f585ce-557a-41e4-bac6-dd5218cfa80b from image 31af6675-704a-43bb-ba2b-df8f937acc30 at location (None, [{'url': 'file:///opt/stack/data/glance/images/31af6675-704a-43bb-ba2b-df8f937acc30', 'metadata': {}}]). {{(pid=94407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4" returned: 0 in 0.319s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.231s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1176363550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85af9250ccd40e39c75899b1f0f2920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:03Z,use_quota=True,user_id='7103a6f45d104b0f90879db1a9f76c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Creating volume e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:06 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:06 devstack sudo[113557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387 1073741824 Aug 26 16:29:06 devstack sudo[113557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfabff98-4360-4a1b-80e6-4792cb360f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4dd0809-5770-4ffe-bb90-89450e73a8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:06 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Volume volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4 (bf91adb9-4db6-49ab-ba66-6608b180f6f4): created successfully Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4dd0809-5770-4ffe-bb90-89450e73a8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Flow 'volume_create_manager' (1795e220-fc96-4430-ae44-85e64af0e5d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 16:29:06 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Image download 0.00 MB at 0.00 MB/s Aug 26 16:29:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9da82a4c-954e-47ea-aba5-84866597bd93 tempest-CreateVolumesFromImageTest-1369843917 None] Created volume successfully. Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[986019e5-8b18-4ea3-b95c-0b4a7445ceec]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:06 devstack sudo[113554]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:06 devstack sudo[113561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD Aug 26 16:29:06 devstack sudo[113561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:06 devstack sudo[113563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD Aug 26 16:29:06 devstack sudo[113563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:06 devstack sudo[113561]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:06 devstack sudo[113563]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:06 devstack sudo[113557]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387 1073741824" returned: 0 in 0.610s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:06 devstack sudo[113575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387 Aug 26 16:29:06 devstack sudo[113575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:06 devstack sudo[113574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD Aug 26 16:29:06 devstack sudo[113574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:07 devstack sudo[113575]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387" returned: 0 in 0.237s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.886s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:07 devstack sudo[113574]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Temporary image 31af6675-704a-43bb-ba2b-df8f937acc30 is fetched for user 8417c84dff9548c3844265b4b446e25a. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Creating offline snapshot 71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 of volume 8d788e49-adf7-4c59-b40e-a694d7799b6c {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11aaac53-8f48-477f-acee-a720ce3bf932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9bf1e1-1e7c-43e1-9f72-06504b15743d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec04886-668b-44d5-b87a-8fffe0a6491b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:07 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Volume volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387 (e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387): created successfully Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9bf1e1-1e7c-43e1-9f72-06504b15743d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Flow 'volume_create_manager' (f3d6e1ba-7e3b-4563-9dea-3f159b456da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:07 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-db5a701e-42d6-42ba-83a2-f9936f41b281 tempest-CreateVolumesFromImageTest-1369843917 None] Created volume successfully. Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df2d8e1-52d9-46c9-be05-73c351bbc130]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:07 devstack sudo[113582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c Aug 26 16:29:07 devstack sudo[113582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "cinder-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "cinder-quobyte-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:07 devstack sudo[113583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD Aug 26 16:29:07 devstack sudo[113583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-quobyte-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae3502a-76f0-46fb-aa62-9b60dcc7fc16]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:07 devstack sudo[113586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387 Aug 26 16:29:07 devstack sudo[113586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:07 devstack sudo[113582]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c" returned: 0 in 0.435s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:07 devstack sudo[113591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 1G Aug 26 16:29:07 devstack sudo[113591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:07 devstack sudo[113583]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:07 devstack sudo[113595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD Aug 26 16:29:07 devstack sudo[113595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:07 devstack sudo[113586]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387" returned: 0 in 0.399s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:07 devstack sudo[113603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387 Aug 26 16:29:07 devstack sudo[113603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:08 devstack sudo[113595]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:08 devstack sudo[113591]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 1G" returned: 0 in 0.474s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d788e49-adf7-4c59-b40e-a694d7799b6c -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:08 devstack sudo[113610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d788e49-adf7-4c59-b40e-a694d7799b6c -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 Aug 26 16:29:08 devstack sudo[113610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:08 devstack sudo[113603]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387" returned: 0 in 0.279s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-quobyte-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387" released by "delete_volume" :: held 0.722s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Created reservations ['890cc090-c10b-49f3-a35c-d1d6587e463a', '8a56343a-4bb3-4d0f-8ac9-cbbff144167a', '3f08abf1-a9f8-43a6-b544-1d7a2ec63cc6', '9e38c80d-6258-4fd2-8f6f-274b655e8bb6'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:08 devstack sudo[113615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:08 devstack sudo[113615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:08 devstack sudo[113610]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d788e49-adf7-4c59-b40e-a694d7799b6c -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5" returned: 0 in 0.304s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:08 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 is being set with open permissions: ugo+rw Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:08 devstack sudo[113618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 Aug 26 16:29:08 devstack sudo[113618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:08 devstack sudo[113615]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.247s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "cinder-bf91adb9-4db6-49ab-ba66-6608b180f6f4-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Deleted volume successfully. Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-bf91adb9-4db6-49ab-ba66-6608b180f6f4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0d71ffa4-a184-413b-9db2-952da526b7c9 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-e3a4163d-bf7f-4f83-a25f-e0ec1a3ac387-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "cinder-quobyte-bf91adb9-4db6-49ab-ba66-6608b180f6f4" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:08 devstack sudo[113618]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-quobyte-bf91adb9-4db6-49ab-ba66-6608b180f6f4" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5" returned: 0 in 0.285s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7a86a4-1aa5-418e-94b2-3f6d1cefe619]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:08 devstack sudo[113623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.info Aug 26 16:29:08 devstack sudo[113623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:08 devstack sudo[113622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4 Aug 26 16:29:08 devstack sudo[113622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:08 devstack sudo[113623]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.info" returned: 0 in 0.268s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:08 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.info is being set with open permissions: ugo+rw Aug 26 16:29:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:08 devstack sudo[113629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.info Aug 26 16:29:08 devstack sudo[113629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:09 devstack sudo[113622]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4" returned: 0 in 0.375s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:09 devstack sudo[113632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4 Aug 26 16:29:09 devstack sudo[113632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:09 devstack sudo[113629]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.info" returned: 0 in 0.256s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.441s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6245e177-3ec6-42ca-ab7c-2f05617430e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1bb8eb4282949a39cfbc43f2402470c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:05Z,use_quota=True,user_id='4607049ff4ec456282a5d2dcdcd9e3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Creating volume 6245e177-3ec6-42ca-ab7c-2f05617430e3 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:09 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:09 devstack sudo[113632]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:09 devstack sudo[113636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 1073741824 Aug 26 16:29:09 devstack sudo[113636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bf91adb9-4db6-49ab-ba66-6608b180f6f4" returned: 0 in 0.252s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-quobyte-bf91adb9-4db6-49ab-ba66-6608b180f6f4" released by "delete_volume" :: held 0.671s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a05a5e98-8791-4eb3-a124-46740a604342 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Create snapshot completed successfully Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Created reservations ['7c0cca77-4800-43ac-8884-c405e66810e5', '257ab136-10f8-44bc-878d-83631b2ab086', '68dc1478-98f1-41a4-9a64-ba4223c3913d', '65cd5599-6bf6-4cd8-8d7f-79a5af125576'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:09 devstack sudo[113638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:09 devstack sudo[113638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:09 devstack sudo[113638]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.267s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Deleted volume successfully. Aug 26 16:29:09 devstack sudo[113636]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-73790d49-a9f2-45bf-a431-1d7719447441 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-bf91adb9-4db6-49ab-ba66-6608b180f6f4-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 1073741824" returned: 0 in 0.486s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "cinder-030a3f6a-fdf4-42fe-a62e-60ca590dae7a-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-030a3f6a-fdf4-42fe-a62e-60ca590dae7a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:09 devstack sudo[113644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 Aug 26 16:29:09 devstack sudo[113644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "cinder-quobyte-030a3f6a-fdf4-42fe-a62e-60ca590dae7a" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-quobyte-030a3f6a-fdf4-42fe-a62e-60ca590dae7a" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e538e41-c46b-41a0-bebf-0a7d383a0135]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:10 devstack sudo[113646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a Aug 26 16:29:10 devstack sudo[113646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:10 devstack sudo[113644]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3" returned: 0 in 0.339s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.128s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f585ce-557a-41e4-bac6-dd5218cfa80b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04759b3aa8347828a5d5805d9f259ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:06Z,use_quota=True,user_id='8417c84dff9548c3844265b4b446e25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2738b47-8ab4-4bfa-8c0f-181082a9561d),volume_type_id=d2738b47-8ab4-4bfa-8c0f-181082a9561d)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Creating volume 86f585ce-557a-41e4-bac6-dd5218cfa80b {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:10 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:10 devstack sudo[113649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b 1073741824 Aug 26 16:29:10 devstack sudo[113649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Flow 'volume_create_manager' (5d37f50a-5be3-4aeb-ac17-e63c2d83714c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003fc182-f5b1-4fd5-9b5e-d1021b9ac053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Attempting download of 92fdc8a0-33fe-4280-9469-2ce7b2bb204d ((None, [{'url': 'file:///opt/stack/data/glance/images/92fdc8a0-33fe-4280-9469-2ce7b2bb204d', 'metadata': {}}])) to volume 6245e177-3ec6-42ca-ab7c-2f05617430e3. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003fc182-f5b1-4fd5-9b5e-d1021b9ac053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692636041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef5f43a-8761-4d03-9445-0741c182c187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33279950794746aa99ee737b6f3c4e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:10Z,use_quota=True,user_id='22a12cddb7d64bf8a77e6b9999402cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5a340e-1756-442b-9127-34447fcd64e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5a340e-1756-442b-9127-34447fcd64e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a683ccf7-26b3-4739-bd3b-605cbbfbb75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a683ccf7-26b3-4739-bd3b-605cbbfbb75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef5f43a-8761-4d03-9445-0741c182c187', 'volume_name': 'volume-cef5f43a-8761-4d03-9445-0741c182c187', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f830f841-daa3-412e-b3f1-83196a806850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f830f841-daa3-412e-b3f1-83196a806850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13273e36-5fc7-4121-89bc-9e7f3e18ad23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:10 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume cef5f43a-8761-4d03-9445-0741c182c187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef5f43a-8761-4d03-9445-0741c182c187', 'volume_size': 1} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[451d1bf0-c69c-4182-9634-132c84acfe75]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_us_vke03 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:10 devstack sudo[113646]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a" returned: 0 in 0.488s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:10 devstack sudo[113655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a Aug 26 16:29:10 devstack sudo[113655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:10 devstack sudo[113654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_us_vke03 Aug 26 16:29:10 devstack sudo[113654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Flow 'volume_create_manager' (b447fd40-4ec7-441e-9ac1-e0ed6874fa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3d5023-a25e-4b64-982a-26b5da26f06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3d5023-a25e-4b64-982a-26b5da26f06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-400815081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b36346-f9cc-41ee-b863-4d890bb79009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33279950794746aa99ee737b6f3c4e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:10Z,use_quota=True,user_id='22a12cddb7d64bf8a77e6b9999402cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f84cb3-93b7-44b9-8eb3-1e87160a354e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f84cb3-93b7-44b9-8eb3-1e87160a354e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05821758-3cc1-4247-944a-09f7cb8b9246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05821758-3cc1-4247-944a-09f7cb8b9246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b36346-f9cc-41ee-b863-4d890bb79009', 'volume_name': 'volume-f6b36346-f9cc-41ee-b863-4d890bb79009', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b9b781-65cb-497e-80a1-5f64253a255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b9b781-65cb-497e-80a1-5f64253a255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a3f98c-e892-41be-9f9c-635eac1bfede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:10 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume f6b36346-f9cc-41ee-b863-4d890bb79009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b36346-f9cc-41ee-b863-4d890bb79009', 'volume_size': 1} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:10 devstack sudo[113655]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-030a3f6a-fdf4-42fe-a62e-60ca590dae7a" returned: 0 in 0.330s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-quobyte-030a3f6a-fdf4-42fe-a62e-60ca590dae7a" released by "delete_volume" :: held 0.883s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:10 devstack sudo[113649]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b 1073741824" returned: 0 in 0.642s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Created reservations ['98a1c1b0-d748-41a1-bc46-c9a8a53e4b56', '3b421d53-13c7-45d3-9fa0-316ae4b666f9', 'a83f4d66-9262-4b17-9b35-be64076854cf', 'f4a06e36-1294-433d-9a82-9dd529238cc1'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:10 devstack sudo[113654]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_us_vke03" returned: 0 in 0.566s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:10 devstack sudo[113665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_us_vke03 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:10 devstack sudo[113665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:11 devstack sudo[113668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:11 devstack sudo[113668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Flow 'volume_create_manager' (bdc80ac5-6991-4fce-bb18-a761b6aa8f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:11 devstack sudo[113667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_us_vke03 Aug 26 16:29:11 devstack sudo[113667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5481686-1cf0-4c5a-ae40-89c52f30bac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5481686-1cf0-4c5a-ae40-89c52f30bac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1139852869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ad1dba-1862-45e6-8711-40c0239e908e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33279950794746aa99ee737b6f3c4e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:11Z,use_quota=True,user_id='22a12cddb7d64bf8a77e6b9999402cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3366e25-99c7-4746-a2c3-7e89ec2281e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3366e25-99c7-4746-a2c3-7e89ec2281e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798937d6-20f2-4f09-9233-20cb2dfb14e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798937d6-20f2-4f09-9233-20cb2dfb14e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ad1dba-1862-45e6-8711-40c0239e908e', 'volume_name': 'volume-f2ad1dba-1862-45e6-8711-40c0239e908e', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d389a69-05db-4b67-bd0f-2becdad3a9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d389a69-05db-4b67-bd0f-2becdad3a9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb5d072-7719-44b3-98a5-3c46f3623a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:11 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume f2ad1dba-1862-45e6-8711-40c0239e908e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ad1dba-1862-45e6-8711-40c0239e908e', 'volume_size': 1} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:11 devstack sudo[113665]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b" returned: 0 in 0.390s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.954s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692636041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef5f43a-8761-4d03-9445-0741c182c187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33279950794746aa99ee737b6f3c4e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:10Z,use_quota=True,user_id='22a12cddb7d64bf8a77e6b9999402cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Creating volume cef5f43a-8761-4d03-9445-0741c182c187 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:11 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cef5f43a-8761-4d03-9445-0741c182c187 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:11 devstack sudo[113673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cef5f43a-8761-4d03-9445-0741c182c187 1073741824 Aug 26 16:29:11 devstack sudo[113668]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:11 devstack sudo[113673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.324s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Attempting download of 31af6675-704a-43bb-ba2b-df8f937acc30 ((None, [{'url': 'file:///opt/stack/data/glance/images/31af6675-704a-43bb-ba2b-df8f937acc30', 'metadata': {}}])) to volume 86f585ce-557a-41e4-bac6-dd5218cfa80b. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:11 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Deleted volume successfully. Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9556527b-4909-4b79-9fc9-752c7b05c136 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-030a3f6a-fdf4-42fe-a62e-60ca590dae7a-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[67998b4e-ec53-4a10-99ed-ababbcbbb3e9]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_31af6675-704a-43bb-ba2b-df8f937acc30_t74gm11n {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:11 devstack sudo[113667]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_us_vke03" returned: 1 in 0.539s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_us_vke03' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59ab143-f0d8-4b6d-a9ce-43c62bdec7c1]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:11 devstack sudo[113677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_31af6675-704a-43bb-ba2b-df8f937acc30_t74gm11n Aug 26 16:29:11 devstack sudo[113677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:11 devstack sudo[113678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD Aug 26 16:29:11 devstack sudo[113678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Flow 'volume_create_manager' (a2788cd5-3389-4d2d-9234-59d82a5b60c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394dd455-cd88-4943-9c31-02ecd0f1ad46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394dd455-cd88-4943-9c31-02ecd0f1ad46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000475176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590514ca-4cdb-418d-8ca1-11576f63d00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33279950794746aa99ee737b6f3c4e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:12Z,use_quota=True,user_id='22a12cddb7d64bf8a77e6b9999402cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc60b44-2ba7-4b5a-b50f-56f2b5395e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc60b44-2ba7-4b5a-b50f-56f2b5395e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77356d6-1b7f-456e-a067-049a63cb2051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77356d6-1b7f-456e-a067-049a63cb2051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590514ca-4cdb-418d-8ca1-11576f63d00a', 'volume_name': 'volume-590514ca-4cdb-418d-8ca1-11576f63d00a', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7e0894-1e54-46ba-a679-d52f72f929b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7e0894-1e54-46ba-a679-d52f72f929b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226877f5-0e17-44c7-aecf-bada16903dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:11 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume 590514ca-4cdb-418d-8ca1-11576f63d00a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590514ca-4cdb-418d-8ca1-11576f63d00a', 'volume_size': 1} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:11 devstack sudo[113677]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_31af6675-704a-43bb-ba2b-df8f937acc30_t74gm11n" returned: 0 in 0.418s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31af6675-704a-43bb-ba2b-df8f937acc30_t74gm11n {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:11 devstack sudo[113673]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cef5f43a-8761-4d03-9445-0741c182c187 1073741824" returned: 0 in 0.650s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cef5f43a-8761-4d03-9445-0741c182c187 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:12 devstack sudo[113688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31af6675-704a-43bb-ba2b-df8f937acc30_t74gm11n Aug 26 16:29:12 devstack sudo[113688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:12 devstack sudo[113689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cef5f43a-8761-4d03-9445-0741c182c187 Aug 26 16:29:12 devstack sudo[113689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:12 devstack sudo[113678]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD" returned: 0 in 0.641s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "cinder-934e394b-e241-4ee9-bfc6-eef5f95968ed-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Flow 'volume_create_manager' (5bfd7460-65a3-41f4-ae66-10cc9708935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8de4c7-42ae-4540-b1ac-56fe9be752e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-934e394b-e241-4ee9-bfc6-eef5f95968ed-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:12 devstack sudo[113694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD Aug 26 16:29:12 devstack sudo[113694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8de4c7-42ae-4540-b1ac-56fe9be752e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-74527468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f439df30-2987-403a-8f42-cedfb82393b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33279950794746aa99ee737b6f3c4e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:12Z,use_quota=True,user_id='22a12cddb7d64bf8a77e6b9999402cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01c0de2-2217-47ff-aead-f8fb39cbe949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01c0de2-2217-47ff-aead-f8fb39cbe949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8599448-4fa8-49e7-ba18-470e6e5e98b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8599448-4fa8-49e7-ba18-470e6e5e98b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f439df30-2987-403a-8f42-cedfb82393b6', 'volume_name': 'volume-f439df30-2987-403a-8f42-cedfb82393b6', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa550f3f-f923-40d6-b659-6706e15373c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa550f3f-f923-40d6-b659-6706e15373c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a030a8a7-3a70-4a95-a71d-d45f92ff1ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:12 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume f439df30-2987-403a-8f42-cedfb82393b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f439df30-2987-403a-8f42-cedfb82393b6', 'volume_size': 1} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "cinder-quobyte-934e394b-e241-4ee9-bfc6-eef5f95968ed" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-quobyte-934e394b-e241-4ee9-bfc6-eef5f95968ed" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:12 devstack sudo[113689]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:12 devstack sudo[113688]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31af6675-704a-43bb-ba2b-df8f937acc30_t74gm11n" returned: 1 in 0.567s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31af6675-704a-43bb-ba2b-df8f937acc30_t74gm11n' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cef5f43a-8761-4d03-9445-0741c182c187" returned: 0 in 0.424s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce964762-a58c-42d2-b717-61a219ac53d0]: (4, 'raw') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.728s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-400815081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b36346-f9cc-41ee-b863-4d890bb79009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33279950794746aa99ee737b6f3c4e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:10Z,use_quota=True,user_id='22a12cddb7d64bf8a77e6b9999402cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Creating volume f6b36346-f9cc-41ee-b863-4d890bb79009 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:12 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f6b36346-f9cc-41ee-b863-4d890bb79009 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aca3f61-6665-46f8-9d69-7554fa18c32d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-934e394b-e241-4ee9-bfc6-eef5f95968ed {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:12 devstack sudo[113699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f6b36346-f9cc-41ee-b863-4d890bb79009 1073741824 Aug 26 16:29:12 devstack sudo[113699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13273e36-5fc7-4121-89bc-9e7f3e18ad23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef5f43a-8761-4d03-9445-0741c182c187', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a58d5a-345f-49a5-abd4-67b232c6b9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:12 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume volume-cef5f43a-8761-4d03-9445-0741c182c187 (cef5f43a-8761-4d03-9445-0741c182c187): created successfully Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a58d5a-345f-49a5-abd4-67b232c6b9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Flow 'volume_create_manager' (5d37f50a-5be3-4aeb-ac17-e63c2d83714c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:12 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-40e89377-0151-4b60-9dae-d208287cba8b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Created volume successfully. Aug 26 16:29:12 devstack sudo[113700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD Aug 26 16:29:12 devstack sudo[113700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:12 devstack sudo[113694]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD" returned: 1 in 0.498s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] 92fdc8a0-33fe-4280-9469-2ce7b2bb204d was raw, converting to qcow2 {{(pid=94407) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 16:29:12 devstack sudo[113702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-934e394b-e241-4ee9-bfc6-eef5f95968ed Aug 26 16:29:12 devstack sudo[113702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:12 devstack sudo[113708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 Aug 26 16:29:12 devstack sudo[113708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:12 devstack sudo[113700]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:12 devstack sudo[113702]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-934e394b-e241-4ee9-bfc6-eef5f95968ed" returned: 0 in 0.464s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-934e394b-e241-4ee9-bfc6-eef5f95968ed {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:12 devstack sudo[113717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD Aug 26 16:29:12 devstack sudo[113717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:12 devstack sudo[113723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-934e394b-e241-4ee9-bfc6-eef5f95968ed Aug 26 16:29:12 devstack sudo[113723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:12 devstack sudo[113699]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f6b36346-f9cc-41ee-b863-4d890bb79009 1073741824" returned: 0 in 0.561s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f6b36346-f9cc-41ee-b863-4d890bb79009 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:13 devstack sudo[113726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f6b36346-f9cc-41ee-b863-4d890bb79009 Aug 26 16:29:13 devstack sudo[113726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:13 devstack sudo[113708]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3" returned: 0 in 0.554s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_92fdc8a0-33fe-4280-9469-2ce7b2bb204d_zu85n9imdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:29:13 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:13 devstack sudo[113730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 1G Aug 26 16:29:13 devstack sudo[113730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:13 devstack sudo[113717]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] 31af6675-704a-43bb-ba2b-df8f937acc30 was raw, converting to qcow2 {{(pid=94407) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:13 devstack sudo[113723]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-934e394b-e241-4ee9-bfc6-eef5f95968ed" returned: 0 in 0.311s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:13 devstack sudo[113734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b Aug 26 16:29:13 devstack sudo[113734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-quobyte-934e394b-e241-4ee9-bfc6-eef5f95968ed" released by "delete_volume" :: held 0.857s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Created reservations ['d3b1d660-5af8-45af-9460-e416cafa713d', '0e118d6c-4781-48fa-957a-d227da996d85', '7c6f6abc-0ee1-4a68-9c73-9e1acdfecfed', 'b7126db2-4a13-446a-8eed-7bb0601e6156'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:13 devstack sudo[113726]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f6b36346-f9cc-41ee-b863-4d890bb79009" returned: 0 in 0.353s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.248s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1139852869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ad1dba-1862-45e6-8711-40c0239e908e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33279950794746aa99ee737b6f3c4e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:11Z,use_quota=True,user_id='22a12cddb7d64bf8a77e6b9999402cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Creating volume f2ad1dba-1862-45e6-8711-40c0239e908e {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:13 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f2ad1dba-1862-45e6-8711-40c0239e908e 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:13 devstack sudo[113737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f2ad1dba-1862-45e6-8711-40c0239e908e 1073741824 Aug 26 16:29:13 devstack sudo[113737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a3f98c-e892-41be-9f9c-635eac1bfede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b36346-f9cc-41ee-b863-4d890bb79009', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1179c802-316c-4388-a691-dc26b852b06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:13 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume volume-f6b36346-f9cc-41ee-b863-4d890bb79009 (f6b36346-f9cc-41ee-b863-4d890bb79009): created successfully Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1179c802-316c-4388-a691-dc26b852b06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Flow 'volume_create_manager' (b447fd40-4ec7-441e-9ac1-e0ed6874fa9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e6118aab-205f-4d3b-971e-3cb6e6a9ba3d tempest-CreateVolumesFromSnapshotTest-1925240358 None] Created volume successfully. Aug 26 16:29:13 devstack sudo[113746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:13 devstack sudo[113746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:13 devstack sudo[113730]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 1G" returned: 0 in 0.436s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Downloaded image 92fdc8a0-33fe-4280-9469-2ce7b2bb204d ((None, [{'url': 'file:///opt/stack/data/glance/images/92fdc8a0-33fe-4280-9469-2ce7b2bb204d', 'metadata': {}}])) to volume 6245e177-3ec6-42ca-ab7c-2f05617430e3 successfully. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Temporary image 92fdc8a0-33fe-4280-9469-2ce7b2bb204d for user 4607049ff4ec456282a5d2dcdcd9e3b0 is deleted. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Marking volume 6245e177-3ec6-42ca-ab7c-2f05617430e3 as bootable. {{(pid=94407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Copying metadata from image 92fdc8a0-33fe-4280-9469-2ce7b2bb204d to 6245e177-3ec6-42ca-ab7c-2f05617430e3. {{(pid=94407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Creating volume glance metadata for volume 6245e177-3ec6-42ca-ab7c-2f05617430e3 backed by image 92fdc8a0-33fe-4280-9469-2ce7b2bb204d with: {'image_id': '92fdc8a0-33fe-4280-9469-2ce7b2bb204d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f5d23f6a5eaa0382b3a20a8941add4d6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85948ed1-53a1-4e77-aa90-aa62d4e04de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6245e177-3ec6-42ca-ab7c-2f05617430e3', 'volume_size': 1, 'image_id': '92fdc8a0-33fe-4280-9469-2ce7b2bb204d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92fdc8a0-33fe-4280-9469-2ce7b2bb204d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5d23f6a5eaa0382b3a20a8941add4d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1bb8eb4282949a39cfbc43f2402470c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '264d32a3c263ef3d1f27621a5c20dfe6c1ec5b7e39bc615430cf8a8aae1c8fed40ade81da696ae033621dca32396528741dc8d791f6b2c149105cf701ec7d0f6', 'id': '92fdc8a0-33fe-4280-9469-2ce7b2bb204d', 'created_at': datetime.datetime(2026, 8, 26, 14, 29, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 29, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92fdc8a0-33fe-4280-9469-2ce7b2bb204d/file', 'properties': {}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63022ea0-28dd-4159-b9f1-989d7ec83612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:13 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Volume volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 (6245e177-3ec6-42ca-ab7c-2f05617430e3): created successfully Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63022ea0-28dd-4159-b9f1-989d7ec83612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Flow 'volume_create_manager' (9216384d-c40b-42d3-9ccb-da9128e19d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9b6d0f39-2bab-4118-8e9f-647050226087 tempest-VolumeImageDependencyTests-2016042271 None] Created volume successfully. Aug 26 16:29:13 devstack sudo[113734]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b" returned: 0 in 0.556s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_31af6675-704a-43bb-ba2b-df8f937acc30_mefhmqcfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:29:13 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:13 devstack sudo[113753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b 1G Aug 26 16:29:13 devstack sudo[113753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:13 devstack sudo[113746]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.293s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Deleted volume successfully. Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-55d43127-7804-44d5-b81e-5a6e646546b8 tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-934e394b-e241-4ee9-bfc6-eef5f95968ed-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:13 devstack sudo[113737]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f2ad1dba-1862-45e6-8711-40c0239e908e 1073741824" returned: 0 in 0.530s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f2ad1dba-1862-45e6-8711-40c0239e908e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:14 devstack sudo[113756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f2ad1dba-1862-45e6-8711-40c0239e908e Aug 26 16:29:14 devstack sudo[113756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:14 devstack sudo[113753]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b 1G" returned: 0 in 0.326s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Downloaded image 31af6675-704a-43bb-ba2b-df8f937acc30 ((None, [{'url': 'file:///opt/stack/data/glance/images/31af6675-704a-43bb-ba2b-df8f937acc30', 'metadata': {}}])) to volume 86f585ce-557a-41e4-bac6-dd5218cfa80b successfully. {{(pid=94407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Temporary image 31af6675-704a-43bb-ba2b-df8f937acc30 for user 8417c84dff9548c3844265b4b446e25a is deleted. {{(pid=94407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.volume_utils [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Marking volume 86f585ce-557a-41e4-bac6-dd5218cfa80b as bootable. {{(pid=94407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Copying metadata from image 31af6675-704a-43bb-ba2b-df8f937acc30 to 86f585ce-557a-41e4-bac6-dd5218cfa80b. {{(pid=94407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Creating volume glance metadata for volume 86f585ce-557a-41e4-bac6-dd5218cfa80b backed by image 31af6675-704a-43bb-ba2b-df8f937acc30 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '31af6675-704a-43bb-ba2b-df8f937acc30', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '37ef66e438177f6e7482be67914b7d7e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf618fb-c320-47be-a971-4f32cb4ba260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f585ce-557a-41e4-bac6-dd5218cfa80b', 'volume_size': 1, 'image_id': '31af6675-704a-43bb-ba2b-df8f937acc30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/31af6675-704a-43bb-ba2b-df8f937acc30', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37ef66e438177f6e7482be67914b7d7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b04759b3aa8347828a5d5805d9f259ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '413effba996be20a1f65e0a5ba75ddaf6c6944724ccd9c79c2b347a8a2daf02db732a21666082536e6bc68fd6c5aaa73d728abac3eb936933c72eb330b52fc6b', 'id': '31af6675-704a-43bb-ba2b-df8f937acc30', 'created_at': datetime.datetime(2026, 8, 26, 14, 29, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 14, 29, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/31af6675-704a-43bb-ba2b-df8f937acc30/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3869e2-1c7e-4af6-981c-aac1930bca0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:14 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Volume volume-86f585ce-557a-41e4-bac6-dd5218cfa80b (86f585ce-557a-41e4-bac6-dd5218cfa80b): created successfully Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3869e2-1c7e-4af6-981c-aac1930bca0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Flow 'volume_create_manager' (e03a447a-36d4-476a-b86e-377e5638f220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:14 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5dd1ee7b-676f-401a-8a43-8262d91c1f7e tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Created volume successfully. Aug 26 16:29:14 devstack sudo[113756]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f2ad1dba-1862-45e6-8711-40c0239e908e" returned: 0 in 0.280s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.546s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000475176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590514ca-4cdb-418d-8ca1-11576f63d00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33279950794746aa99ee737b6f3c4e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:12Z,use_quota=True,user_id='22a12cddb7d64bf8a77e6b9999402cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Creating volume 590514ca-4cdb-418d-8ca1-11576f63d00a {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:14 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-590514ca-4cdb-418d-8ca1-11576f63d00a 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb5d072-7719-44b3-98a5-3c46f3623a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ad1dba-1862-45e6-8711-40c0239e908e', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e74f6d-f02f-40c2-a09d-9e9d866bc079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:14 devstack sudo[113762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-590514ca-4cdb-418d-8ca1-11576f63d00a 1073741824 Aug 26 16:29:14 devstack sudo[113762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:14 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume volume-f2ad1dba-1862-45e6-8711-40c0239e908e (f2ad1dba-1862-45e6-8711-40c0239e908e): created successfully Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e74f6d-f02f-40c2-a09d-9e9d866bc079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Flow 'volume_create_manager' (bdc80ac5-6991-4fce-bb18-a761b6aa8f98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:14 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-71d45272-609f-4f96-a5e1-8cde5b8389d4 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Created volume successfully. Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Acquiring lock "cinder-6245e177-3ec6-42ca-ab7c-2f05617430e3-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Acquiring lock "cinder-86f585ce-557a-41e4-bac6-dd5218cfa80b-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Lock "cinder-6245e177-3ec6-42ca-ab7c-2f05617430e3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Lock "cinder-86f585ce-557a-41e4-bac6-dd5218cfa80b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Acquiring lock "cinder-quobyte-6245e177-3ec6-42ca-ab7c-2f05617430e3" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "cinder-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Acquiring lock "cinder-quobyte-86f585ce-557a-41e4-bac6-dd5218cfa80b" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Lock "cinder-quobyte-6245e177-3ec6-42ca-ab7c-2f05617430e3" acquired by "delete_volume" :: waited 0.043s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daa39a7-c3ae-48c1-b1e3-8ca207f89197]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Lock "cinder-quobyte-86f585ce-557a-41e4-bac6-dd5218cfa80b" acquired by "delete_volume" :: waited 0.066s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c53a8d7-c20a-4c4f-92ab-27913b92729d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "cinder-quobyte-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-quobyte-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5" acquired by "delete_volume" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:14 devstack sudo[113768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 Aug 26 16:29:14 devstack sudo[113768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27cf921-070d-4a16-8d2f-953404b6c8a9]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:14 devstack sudo[113762]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-590514ca-4cdb-418d-8ca1-11576f63d00a 1073741824" returned: 0 in 0.564s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:14 devstack sudo[113770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b Aug 26 16:29:14 devstack sudo[113770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-590514ca-4cdb-418d-8ca1-11576f63d00a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:14 devstack sudo[113774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-590514ca-4cdb-418d-8ca1-11576f63d00a Aug 26 16:29:14 devstack sudo[113774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:14 devstack sudo[113772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5 Aug 26 16:29:14 devstack sudo[113772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:15 devstack sudo[113768]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3" returned: 0 in 0.408s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:15 devstack sudo[113782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3 Aug 26 16:29:15 devstack sudo[113782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:15 devstack sudo[113770]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b" returned: 0 in 0.424s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:15 devstack sudo[113774]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-590514ca-4cdb-418d-8ca1-11576f63d00a" returned: 0 in 0.302s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.840s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-74527468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f439df30-2987-403a-8f42-cedfb82393b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33279950794746aa99ee737b6f3c4e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:12Z,use_quota=True,user_id='22a12cddb7d64bf8a77e6b9999402cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Creating volume f439df30-2987-403a-8f42-cedfb82393b6 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:15 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f439df30-2987-403a-8f42-cedfb82393b6 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:15 devstack sudo[113789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b Aug 26 16:29:15 devstack sudo[113789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226877f5-0e17-44c7-aecf-bada16903dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590514ca-4cdb-418d-8ca1-11576f63d00a', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb5e1f4-0579-40ef-81dc-f7ed7b3b0596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:15 devstack sudo[113792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f439df30-2987-403a-8f42-cedfb82393b6 1073741824 Aug 26 16:29:15 devstack sudo[113792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:15 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume volume-590514ca-4cdb-418d-8ca1-11576f63d00a (590514ca-4cdb-418d-8ca1-11576f63d00a): created successfully Aug 26 16:29:15 devstack sudo[113772]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb5e1f4-0579-40ef-81dc-f7ed7b3b0596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Flow 'volume_create_manager' (a2788cd5-3389-4d2d-9234-59d82a5b60c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5" returned: 0 in 0.481s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:15 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bd4d3963-a089-4c6a-9a4a-d2237c1fb917 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Created volume successfully. Aug 26 16:29:15 devstack sudo[113794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5 Aug 26 16:29:15 devstack sudo[113794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:15 devstack sudo[113782]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6245e177-3ec6-42ca-ab7c-2f05617430e3" returned: 0 in 0.375s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Lock "cinder-quobyte-6245e177-3ec6-42ca-ab7c-2f05617430e3" released by "delete_volume" :: held 0.838s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:15 devstack sudo[113789]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-86f585ce-557a-41e4-bac6-dd5218cfa80b" returned: 0 in 0.331s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Lock "cinder-quobyte-86f585ce-557a-41e4-bac6-dd5218cfa80b" released by "delete_volume" :: held 0.807s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Created reservations ['d59b4e1f-5eef-459d-8822-7ecf1f162f96', 'a6acd39d-6b5f-4d49-b2a6-33d3900a9c7b', '5433fbc6-5a45-428a-8ec0-da174bd4aa79', 'ed356d4c-5df8-4260-87ac-f3ec9bf69875'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Created reservations ['702bfa23-7243-4a5f-a85f-77df676383ff', '85eaf11e-edd0-41d2-af7f-d730c23b3818', '70e29923-8687-44b6-85b5-75dfb7cb99ee', '216e7c45-d77b-42e8-ac2d-9c4b1630f95e'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:15 devstack sudo[113794]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5" returned: 0 in 0.363s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-quobyte-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5" released by "delete_volume" :: held 0.950s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:15 devstack sudo[113802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:15 devstack sudo[113802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:15 devstack sudo[113804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:15 devstack sudo[113804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Created reservations ['54b5a0cb-ff6b-4d8c-bcef-7bd47dedd003', 'bdce3cfc-c57a-4b37-9171-3be5614c3827', '954da699-da48-42e1-942e-90ca3bb94760', 'a0cdff20-b126-4ffb-990d-b417d7660576'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:16 devstack sudo[113792]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f439df30-2987-403a-8f42-cedfb82393b6 1073741824" returned: 0 in 0.830s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:16 devstack sudo[113806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:16 devstack sudo[113806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f439df30-2987-403a-8f42-cedfb82393b6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:16 devstack sudo[113809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f439df30-2987-403a-8f42-cedfb82393b6 Aug 26 16:29:16 devstack sudo[113809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:16 devstack sudo[113802]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.454s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Deleted volume successfully. Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7286d089-adc2-403d-96cb-2f6f4ff38aa3 tempest-VolumeImageDependencyTests-2016042271 None] Lock "cinder-6245e177-3ec6-42ca-ab7c-2f05617430e3-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:16 devstack sudo[113804]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.454s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Deleted volume successfully. Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a30ffe4b-8f2a-4bfc-8254-b01756cf91a0 tempest-VolumeAndVolumeTypeFromImageTest-608481698 None] Lock "cinder-86f585ce-557a-41e4-bac6-dd5218cfa80b-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:16 devstack sudo[113806]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.354s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Deleted volume successfully. Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2d3d605c-2678-4a7d-adca-563ad72ca40b tempest-CreateVolumesFromImageTest-1369843917 None] Lock "cinder-9582cd15-7a4f-4e3e-aa39-a1181ad8e2a5-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:16 devstack sudo[113809]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f439df30-2987-403a-8f42-cedfb82393b6" returned: 0 in 0.361s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a030a8a7-3a70-4a95-a71d-d45f92ff1ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f439df30-2987-403a-8f42-cedfb82393b6', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a4473d-73aa-4d0e-ba2a-36f46221ce9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:16 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Volume volume-f439df30-2987-403a-8f42-cedfb82393b6 (f439df30-2987-403a-8f42-cedfb82393b6): created successfully Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a4473d-73aa-4d0e-ba2a-36f46221ce9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Flow 'volume_create_manager' (5bfd7460-65a3-41f4-ae66-10cc9708935f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a81aadb8-678f-484b-8d35-4767fa80b772 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Created volume successfully. Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-f439df30-2987-403a-8f42-cedfb82393b6-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-f439df30-2987-403a-8f42-cedfb82393b6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-quobyte-f439df30-2987-403a-8f42-cedfb82393b6" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-f439df30-2987-403a-8f42-cedfb82393b6" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c018146b-59b2-4584-a64c-42abf285d58b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f439df30-2987-403a-8f42-cedfb82393b6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:16 devstack sudo[113814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f439df30-2987-403a-8f42-cedfb82393b6 Aug 26 16:29:16 devstack sudo[113814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:17 devstack sudo[113814]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f439df30-2987-403a-8f42-cedfb82393b6" returned: 0 in 0.462s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f439df30-2987-403a-8f42-cedfb82393b6 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:17 devstack sudo[113819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f439df30-2987-403a-8f42-cedfb82393b6 Aug 26 16:29:17 devstack sudo[113819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:17 devstack sudo[113819]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f439df30-2987-403a-8f42-cedfb82393b6" returned: 0 in 0.270s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-f439df30-2987-403a-8f42-cedfb82393b6" released by "delete_volume" :: held 0.778s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Created reservations ['6b764607-7b01-47ff-9665-fe71a727d2ff', '2b57320e-a836-4870-86ea-ff10a7977c9f', '43503b27-b79b-407a-995f-55eb2cfd94ac', '45306b00-23ea-44e5-a6ea-633304f6a2b3'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:17 devstack sudo[113822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:17 devstack sudo[113822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-590514ca-4cdb-418d-8ca1-11576f63d00a-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-590514ca-4cdb-418d-8ca1-11576f63d00a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:18 devstack sudo[113825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:18 devstack sudo[113825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-quobyte-590514ca-4cdb-418d-8ca1-11576f63d00a" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-590514ca-4cdb-418d-8ca1-11576f63d00a" acquired by "delete_volume" :: waited 0.027s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:18 devstack sudo[113822]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.391s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:18 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Deleted volume successfully. Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc04280-7ced-475f-a7ac-e113340192ba]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-590514ca-4cdb-418d-8ca1-11576f63d00a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-30e650c1-84a6-40d8-b031-c3a1d91d2dcf tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-f439df30-2987-403a-8f42-cedfb82393b6-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:18 devstack sudo[113827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-590514ca-4cdb-418d-8ca1-11576f63d00a Aug 26 16:29:18 devstack sudo[113827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:18 devstack sudo[113825]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.380s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 29 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:29:18 devstack sudo[113827]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-590514ca-4cdb-418d-8ca1-11576f63d00a" returned: 0 in 0.448s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-590514ca-4cdb-418d-8ca1-11576f63d00a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:18 devstack sudo[113833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-590514ca-4cdb-418d-8ca1-11576f63d00a Aug 26 16:29:18 devstack sudo[113833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:18 devstack sudo[113833]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-590514ca-4cdb-418d-8ca1-11576f63d00a" returned: 0 in 0.356s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-590514ca-4cdb-418d-8ca1-11576f63d00a" released by "delete_volume" :: held 0.880s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:19 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Created reservations ['45660e24-932f-4876-93ed-3002e6445499', '7ffac9f3-fd8f-4bd6-bbf6-5a083d2c733f', 'fda210c4-1976-46e4-bf47-0c1c9b86f184', '38cb0442-296a-4b6e-b63e-69b6fa68cc9e'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:19 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:19 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:19 devstack sudo[113836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:19 devstack sudo[113836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:19 devstack sudo[113836]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.305s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:19 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:19 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Deleted volume successfully. Aug 26 16:29:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-38b7f103-419b-4e10-b854-180703d6b906 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-590514ca-4cdb-418d-8ca1-11576f63d00a-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-f2ad1dba-1862-45e6-8711-40c0239e908e-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-f2ad1dba-1862-45e6-8711-40c0239e908e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-quobyte-f2ad1dba-1862-45e6-8711-40c0239e908e" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-f2ad1dba-1862-45e6-8711-40c0239e908e" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:20 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfb30dd-bbb6-472e-be8a-0d14838fb731]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f2ad1dba-1862-45e6-8711-40c0239e908e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:20 devstack sudo[113839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f2ad1dba-1862-45e6-8711-40c0239e908e Aug 26 16:29:20 devstack sudo[113839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:20 devstack sudo[113839]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f2ad1dba-1862-45e6-8711-40c0239e908e" returned: 0 in 0.402s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f2ad1dba-1862-45e6-8711-40c0239e908e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:20 devstack sudo[113844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f2ad1dba-1862-45e6-8711-40c0239e908e Aug 26 16:29:20 devstack sudo[113844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:21 devstack sudo[113844]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f2ad1dba-1862-45e6-8711-40c0239e908e" returned: 0 in 0.281s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-f2ad1dba-1862-45e6-8711-40c0239e908e" released by "delete_volume" :: held 0.739s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Created reservations ['25a8c5db-101f-49b4-aa8c-fd35b0b84d31', '80fa7237-31d3-488f-a124-0c15be54c105', '465fb653-f5ec-42de-ac9e-72695d00a979', 'c74239ed-f17a-4706-b7ae-4a6af2624ea9'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:21 devstack sudo[113847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:21 devstack sudo[113847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-f6b36346-f9cc-41ee-b863-4d890bb79009-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-f6b36346-f9cc-41ee-b863-4d890bb79009-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-quobyte-f6b36346-f9cc-41ee-b863-4d890bb79009" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-f6b36346-f9cc-41ee-b863-4d890bb79009" acquired by "delete_volume" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:21 devstack sudo[113847]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.424s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49f33c7-d4d8-4ba8-8236-f94d2c0b3105]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f6b36346-f9cc-41ee-b863-4d890bb79009 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:21 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Deleted volume successfully. Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Flow 'volume_create_manager' (839600fb-0b9d-4dfb-9a03-248e761ce6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9277f7b4-484a-4fa4-b8ab-a9ed10a10bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9277f7b4-484a-4fa4-b8ab-a9ed10a10bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-365884649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d889efc-0439-4add-bc9d-330b686d3b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5d6e54d0641d4a573425991021084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:22Z,use_quota=True,user_id='0bc7acf1f1634f1d95bab958553dd785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651e5ce9-a719-41a1-ba2e-a13be8144c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651e5ce9-a719-41a1-ba2e-a13be8144c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00a7bfc-2e50-4dc9-bdf0-bdde7723c798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00a7bfc-2e50-4dc9-bdf0-bdde7723c798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d889efc-0439-4add-bc9d-330b686d3b1a', 'volume_name': 'volume-7d889efc-0439-4add-bc9d-330b686d3b1a', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e220330f-ecc9-4dd6-8d75-13b5525f0a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e220330f-ecc9-4dd6-8d75-13b5525f0a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6724d0-96a1-4d72-b5da-cbe3496cd8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:21 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Volume 7d889efc-0439-4add-bc9d-330b686d3b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d889efc-0439-4add-bc9d-330b686d3b1a', 'volume_size': 1} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-365884649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d889efc-0439-4add-bc9d-330b686d3b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5d6e54d0641d4a573425991021084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:22Z,use_quota=True,user_id='0bc7acf1f1634f1d95bab958553dd785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:21 devstack sudo[113850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f6b36346-f9cc-41ee-b863-4d890bb79009 Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Creating volume 7d889efc-0439-4add-bc9d-330b686d3b1a {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:21 devstack sudo[113850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:21 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-99272ff4-736c-4f19-acfa-1bfa4be31e5b tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-f2ad1dba-1862-45e6-8711-40c0239e908e-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:21 devstack sudo[113852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a 1073741824 Aug 26 16:29:21 devstack sudo[113852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:22 devstack sudo[113850]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f6b36346-f9cc-41ee-b863-4d890bb79009" returned: 0 in 0.505s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f6b36346-f9cc-41ee-b863-4d890bb79009 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:22 devstack sudo[113860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f6b36346-f9cc-41ee-b863-4d890bb79009 Aug 26 16:29:22 devstack sudo[113860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:22 devstack sudo[113852]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a 1073741824" returned: 0 in 0.593s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:22 devstack sudo[113864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a Aug 26 16:29:22 devstack sudo[113864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:22 devstack sudo[113860]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f6b36346-f9cc-41ee-b863-4d890bb79009" returned: 0 in 0.327s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-f6b36346-f9cc-41ee-b863-4d890bb79009" released by "delete_volume" :: held 0.915s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Created reservations ['8a521504-4451-4c27-a754-a8fa06e2fe45', '9fcf1d39-d13d-44f6-ae3e-fcc3772a179d', '5674b2d9-3edc-4ef2-aaf4-5d00101eca70', 'f17a4d04-ac5f-4da4-88d9-979813694601'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:22 devstack sudo[113866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:22 devstack sudo[113866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:22 devstack sudo[113864]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a" returned: 0 in 0.414s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6724d0-96a1-4d72-b5da-cbe3496cd8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d889efc-0439-4add-bc9d-330b686d3b1a', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a305faa-a987-46ee-b233-dca59f41b8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:22 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Volume volume-7d889efc-0439-4add-bc9d-330b686d3b1a (7d889efc-0439-4add-bc9d-330b686d3b1a): created successfully Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a305faa-a987-46ee-b233-dca59f41b8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Flow 'volume_create_manager' (839600fb-0b9d-4dfb-9a03-248e761ce6fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:22 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-54762aca-4f84-4aa2-be5c-86c73cfb0334 tempest-VolumeDependencyTests-1712294153 None] Created volume successfully. Aug 26 16:29:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-8ba418ba-1b13-4816-ab95-7008b1e9b337 tempest-ProjectAdminTests-1688122217 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.81400680542, 'free_capacity_gb': 1774.81400680542, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94407) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 16:29:23 devstack sudo[113866]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.312s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:23 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:23 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Deleted volume successfully. Aug 26 16:29:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-29a11b4e-36c0-4970-988a-bf50f1a833db tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-f6b36346-f9cc-41ee-b863-4d890bb79009-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-cef5f43a-8761-4d03-9445-0741c182c187-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-cef5f43a-8761-4d03-9445-0741c182c187-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-quobyte-cef5f43a-8761-4d03-9445-0741c182c187" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] Creating offline snapshot 3b38e865-b84f-46d8-88de-436e81423468 of volume 7d889efc-0439-4add-bc9d-330b686d3b1a {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:29:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-cef5f43a-8761-4d03-9445-0741c182c187" acquired by "delete_volume" :: waited 0.047s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:24 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fb557a-17ae-4574-8fb2-82e9becb52f5]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:24 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ee4308-25fe-4e4b-8ef9-ff6ced6fc6d3]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cef5f43a-8761-4d03-9445-0741c182c187 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:24 devstack sudo[113870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a Aug 26 16:29:24 devstack sudo[113870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:24 devstack sudo[113871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cef5f43a-8761-4d03-9445-0741c182c187 Aug 26 16:29:24 devstack sudo[113871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:24 devstack sudo[113870]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a" returned: 0 in 0.472s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:24 devstack sudo[113871]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cef5f43a-8761-4d03-9445-0741c182c187" returned: 0 in 0.502s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cef5f43a-8761-4d03-9445-0741c182c187 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:24 devstack sudo[113880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 1G Aug 26 16:29:24 devstack sudo[113880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:24 devstack sudo[113883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cef5f43a-8761-4d03-9445-0741c182c187 Aug 26 16:29:24 devstack sudo[113883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:24 devstack sudo[113883]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-cef5f43a-8761-4d03-9445-0741c182c187" returned: 0 in 0.331s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-cef5f43a-8761-4d03-9445-0741c182c187" released by "delete_volume" :: held 0.897s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Created reservations ['1b5186bd-a6cc-488c-b768-a6ab9b267375', '84bf05e7-6065-4b64-ad12-3fefaa595e24', 'b245b511-c811-49c5-adc1-445bcc9e3ae6', '108cf2cf-cd62-45ba-bc9f-790302521fa6'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:25 devstack sudo[113891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:25 devstack sudo[113880]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:25 devstack sudo[113891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 1G" returned: 0 in 0.658s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d889efc-0439-4add-bc9d-330b686d3b1a -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:25 devstack sudo[113893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d889efc-0439-4add-bc9d-330b686d3b1a -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 Aug 26 16:29:25 devstack sudo[113893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:25 devstack sudo[113891]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.265s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:25 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Deleted volume successfully. Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-119f6f8e-8f7f-4320-9e25-f67298036e0c tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-cef5f43a-8761-4d03-9445-0741c182c187-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:25 devstack sudo[113893]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d889efc-0439-4add-bc9d-330b686d3b1a -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468" returned: 0 in 0.340s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:25 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 is being set with open permissions: ugo+rw Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:25 devstack sudo[113899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 Aug 26 16:29:25 devstack sudo[113899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:25 devstack sudo[113899]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468" returned: 0 in 0.264s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:25 devstack sudo[113902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.info Aug 26 16:29:25 devstack sudo[113902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:26 devstack sudo[113902]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.info" returned: 0 in 0.304s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:26 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.info is being set with open permissions: ugo+rw Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:26 devstack sudo[113905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.info Aug 26 16:29:26 devstack sudo[113905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-71799b60-9096-4ab7-bc9e-3a7e5c2df8a5-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-71799b60-9096-4ab7-bc9e-3a7e5c2df8a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-quobyte-8d788e49-adf7-4c59-b40e-a694d7799b6c" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-8d788e49-adf7-4c59-b40e-a694d7799b6c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-quobyte-71799b60-9096-4ab7-bc9e-3a7e5c2df8a5" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-71799b60-9096-4ab7-bc9e-3a7e5c2df8a5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Deleting offline snapshot 71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 of volume 8d788e49-adf7-4c59-b40e-a694d7799b6c {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] snapshot_file for this snap is: volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[936849a5-394b-44ce-8f82-96ab5185615c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:26 devstack sudo[113905]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.info" returned: 0 in 0.307s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.490s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:26 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bdf89815-eafc-468a-be79-e138ab1b628f tempest-VolumeDependencyTests-1712294153 None] Create snapshot completed successfully Aug 26 16:29:26 devstack sudo[113907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 Aug 26 16:29:26 devstack sudo[113907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:26 devstack sudo[113907]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5" returned: 0 in 0.422s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d788e49-adf7-4c59-b40e-a694d7799b6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b618c1c0-c096-4d0d-b5db-9205dd17ae03]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:26 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:26 devstack sudo[113913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c Aug 26 16:29:26 devstack sudo[113913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:27 devstack sudo[113913]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c" returned: 0 in 0.521s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:27 devstack sudo[113918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 Aug 26 16:29:27 devstack sudo[113918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:27 devstack sudo[113918]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5" returned: 0 in 0.442s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:27 devstack sudo[113923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5 Aug 26 16:29:27 devstack sudo[113923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Flow 'volume_create_manager' (4d8e4d36-b3c7-4e4c-a7d1-a7d380b36439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab48883-e56c-4429-b63b-f3ed735edeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab48883-e56c-4429-b63b-f3ed735edeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1642536313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2775d328-71bf-4ae8-af70-efde0d5e0918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a5d6e54d0641d4a573425991021084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b38e865-b84f-46d8-88de-436e81423468,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:28Z,use_quota=True,user_id='0bc7acf1f1634f1d95bab958553dd785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b91363-f914-4586-a449-6a7f4c7fe702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b91363-f914-4586-a449-6a7f4c7fe702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fa1bcd-4b23-4496-bbde-6945221493fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fa1bcd-4b23-4496-bbde-6945221493fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2775d328-71bf-4ae8-af70-efde0d5e0918', 'volume_name': 'volume-2775d328-71bf-4ae8-af70-efde0d5e0918', 'volume_size': 1, 'snapshot_id': '3b38e865-b84f-46d8-88de-436e81423468'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f49700f-d370-4ee2-a11f-d19b1afbd507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:27 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f49700f-d370-4ee2-a11f-d19b1afbd507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f24161-4975-4a4a-9b79-6705444003f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:28 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Volume 2775d328-71bf-4ae8-af70-efde0d5e0918: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2775d328-71bf-4ae8-af70-efde0d5e0918', 'volume_size': 1, 'snapshot_id': '3b38e865-b84f-46d8-88de-436e81423468'} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "cinder-quobyte-3b38e865-b84f-46d8-88de-436e81423468-2775d328-71bf-4ae8-af70-efde0d5e0918" by "_create_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-quobyte-3b38e865-b84f-46d8-88de-436e81423468-2775d328-71bf-4ae8-af70-efde0d5e0918" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Creating volume 2775d328-71bf-4ae8-af70-efde0d5e0918 from snapshot 3b38e865-b84f-46d8-88de-436e81423468 {{(pid=94407) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "cinder-quobyte-2775d328-71bf-4ae8-af70-efde0d5e0918" by "_copy_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-quobyte-2775d328-71bf-4ae8-af70-efde0d5e0918" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] snapshot: 3b38e865-b84f-46d8-88de-436e81423468, volume: 2775d328-71bf-4ae8-af70-efde0d5e0918, {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 16:29:28 devstack sudo[113923]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c.71799b60-9096-4ab7-bc9e-3a7e5c2df8a5" returned: 0 in 0.429s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cccb31-a897-482a-a260-ddf926501a4e]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-71799b60-9096-4ab7-bc9e-3a7e5c2df8a5" released by "_delete_snapshot" :: held 2.005s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-8d788e49-adf7-4c59-b40e-a694d7799b6c" released by "delete_snapshot" :: held 2.038s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Flow 'volume_create_manager' (f12f61a4-b4d6-4b0b-9c1b-deb9042e1bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1242125-a912-47e1-99d8-8306ab4e038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:28 devstack sudo[113926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 Aug 26 16:29:28 devstack sudo[113926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1242125-a912-47e1-99d8-8306ab4e038e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986685312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9112c5d9-4a90-458a-88f8-fa15f6592013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094516a040fc46c9b0bf6405b1ade1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:28Z,use_quota=True,user_id='b8524ea575bc43c3942aadee8c091467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc235406-414f-4ce9-abbb-aebd05f823e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc235406-414f-4ce9-abbb-aebd05f823e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738988e6-ba77-422b-8ef8-393fdd77f641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738988e6-ba77-422b-8ef8-393fdd77f641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9112c5d9-4a90-458a-88f8-fa15f6592013', 'volume_name': 'volume-9112c5d9-4a90-458a-88f8-fa15f6592013', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bd1bf8-9229-432a-946c-688b6648e35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bd1bf8-9229-432a-946c-688b6648e35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015536a9-659d-4919-976a-6e2dc698ab56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:28 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Volume 9112c5d9-4a90-458a-88f8-fa15f6592013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9112c5d9-4a90-458a-88f8-fa15f6592013', 'volume_size': 1} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Created reservations ['cdf77afd-24e7-4994-b2c0-24ed83e4d53b', 'af7b200e-1b0c-4642-bcc5-9f3a22268d82', '480a0fcf-88f3-4994-8975-aa498c2c2f41', '311a229d-a289-4dfa-a549-ffb3fc046301'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:28 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Delete snapshot completed successfully. Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-50167d61-9c4a-4e4b-aa2d-e81b62b99efc tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-71799b60-9096-4ab7-bc9e-3a7e5c2df8a5-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:28 devstack sudo[113926]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468" returned: 0 in 0.414s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d889efc-0439-4add-bc9d-330b686d3b1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef02882-153a-4d3d-b7cc-85c982848c5a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-8d788e49-adf7-4c59-b40e-a694d7799b6c-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-8d788e49-adf7-4c59-b40e-a694d7799b6c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:28 devstack sudo[113931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a Aug 26 16:29:28 devstack sudo[113931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "cinder-quobyte-8d788e49-adf7-4c59-b40e-a694d7799b6c" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-8d788e49-adf7-4c59-b40e-a694d7799b6c" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9ee578-5692-4e36-a83d-1bc2b571263e]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:29 devstack sudo[113933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c Aug 26 16:29:29 devstack sudo[113933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:29 devstack sudo[113931]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a" returned: 0 in 0.438s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] will copy from snapshot at /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 16:29:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Creating direct copy from snapshot {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 16:29:29 devstack cinder-volume[94407]: DEBUG cinder.utils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Path /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918 not found in is_blk_device check {{(pid=94407) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 16:29:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:29 devstack sudo[113939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918 Aug 26 16:29:29 devstack sudo[113939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:29 devstack sudo[113933]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c" returned: 0 in 0.449s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:29 devstack sudo[113946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c Aug 26 16:29:29 devstack sudo[113946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:29 devstack sudo[113946]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d788e49-adf7-4c59-b40e-a694d7799b6c" returned: 0 in 0.281s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-quobyte-8d788e49-adf7-4c59-b40e-a694d7799b6c" released by "delete_volume" :: held 0.814s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:29 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Created reservations ['1ab51d53-27b6-43d8-a075-90692402048d', '1f5e8d6f-9846-4e97-a544-5d1adc7f1ff3', '31ebd9e0-a9bb-4a96-8de1-8e8a9c7f2416', 'efee942b-636b-4c5b-bdb5-87ecf3c9843a'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:30 devstack sudo[113991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:30 devstack sudo[113991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:31 devstack sudo[113991]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.986s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:31 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:31 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Deleted volume successfully. Aug 26 16:29:31 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-17c8057c-525e-4460-bbc8-d6773edb4fe9 tempest-CreateVolumesFromSnapshotTest-1925240358 None] Lock "cinder-8d788e49-adf7-4c59-b40e-a694d7799b6c-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:34 devstack sudo[113939]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918" returned: 0 in 5.820s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:34 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918 {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:29:34 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Converted 1024.00 MB image at 175.91 MB/s Aug 26 16:29:34 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918 is being set with open permissions: ugo+rw Aug 26 16:29:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:34 devstack sudo[113998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918 Aug 26 16:29:34 devstack sudo[113998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:35 devstack sudo[113998]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918" returned: 0 in 0.252s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-quobyte-2775d328-71bf-4ae8-af70-efde0d5e0918" released by "_copy_volume_from_snapshot" :: held 7.063s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-quobyte-3b38e865-b84f-46d8-88de-436e81423468-2775d328-71bf-4ae8-af70-efde0d5e0918" released by "_create_volume_from_snapshot" :: held 7.168s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.215s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.831s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986685312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9112c5d9-4a90-458a-88f8-fa15f6592013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094516a040fc46c9b0bf6405b1ade1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:28Z,use_quota=True,user_id='b8524ea575bc43c3942aadee8c091467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Creating volume 9112c5d9-4a90-458a-88f8-fa15f6592013 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:35 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:35 devstack sudo[114001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013 1073741824 Aug 26 16:29:35 devstack sudo[114001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f24161-4975-4a4a-9b79-6705444003f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2775d328-71bf-4ae8-af70-efde0d5e0918', 'volume_size': 1, 'snapshot_id': '3b38e865-b84f-46d8-88de-436e81423468'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94417ed9-0582-4d5b-9298-ccd57b4bb769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:35 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Volume volume-2775d328-71bf-4ae8-af70-efde0d5e0918 (2775d328-71bf-4ae8-af70-efde0d5e0918): created successfully Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94417ed9-0582-4d5b-9298-ccd57b4bb769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Flow 'volume_create_manager' (4d8e4d36-b3c7-4e4c-a7d1-a7d380b36439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:35 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-78cd34c2-ce28-42d9-8b5c-dfda12440dad tempest-VolumeDependencyTests-1712294153 None] Created volume successfully. Aug 26 16:29:35 devstack sudo[114001]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013 1073741824" returned: 0 in 0.498s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:35 devstack sudo[114007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013 Aug 26 16:29:35 devstack sudo[114007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:36 devstack sudo[114007]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013" returned: 0 in 0.274s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015536a9-659d-4919-976a-6e2dc698ab56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9112c5d9-4a90-458a-88f8-fa15f6592013', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babfe276-d608-4f8d-97d6-1f35edc6ae7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:36 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Volume volume-9112c5d9-4a90-458a-88f8-fa15f6592013 (9112c5d9-4a90-458a-88f8-fa15f6592013): created successfully Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babfe276-d608-4f8d-97d6-1f35edc6ae7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Flow 'volume_create_manager' (f12f61a4-b4d6-4b0b-9c1b-deb9042e1bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "cinder-3b38e865-b84f-46d8-88de-436e81423468-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:36 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ec3e4650-3dd9-4aa9-ae35-bbb78305e16f tempest-ProjectReaderTests-1638074044 None] Created volume successfully. Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Flow 'volume_create_manager' (d058ee69-f87c-462c-8a03-5ef7616ef660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd4abca-f0b8-4689-bed5-ceab91f35be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-3b38e865-b84f-46d8-88de-436e81423468-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "cinder-quobyte-7d889efc-0439-4add-bc9d-330b686d3b1a" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd4abca-f0b8-4689-bed5-ceab91f35be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-328690281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a22740-b704-4277-9c14-a816fc335d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7502c10e3f4b109622b849fb61cf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:36Z,use_quota=True,user_id='a6b1f613a4874699a14be85dc14ca3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e9c6ad-c7bd-4928-bf29-05d521d447c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e9c6ad-c7bd-4928-bf29-05d521d447c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52850fd3-691a-46a9-aebd-402110e4491c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52850fd3-691a-46a9-aebd-402110e4491c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a22740-b704-4277-9c14-a816fc335d4b', 'volume_name': 'volume-d4a22740-b704-4277-9c14-a816fc335d4b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f67cb49-5105-4938-b2c7-636763b50bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f67cb49-5105-4938-b2c7-636763b50bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6d899d-5207-40f4-98f1-3ee8ab7bdaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:36 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume d4a22740-b704-4277-9c14-a816fc335d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a22740-b704-4277-9c14-a816fc335d4b', 'volume_size': 1} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-328690281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a22740-b704-4277-9c14-a816fc335d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7502c10e3f4b109622b849fb61cf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:36Z,use_quota=True,user_id='a6b1f613a4874699a14be85dc14ca3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Creating volume d4a22740-b704-4277-9c14-a816fc335d4b {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:36 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d4a22740-b704-4277-9c14-a816fc335d4b 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-quobyte-7d889efc-0439-4add-bc9d-330b686d3b1a" acquired by "delete_snapshot" :: waited 0.080s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "cinder-quobyte-3b38e865-b84f-46d8-88de-436e81423468" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-quobyte-3b38e865-b84f-46d8-88de-436e81423468" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:36 devstack sudo[114013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d4a22740-b704-4277-9c14-a816fc335d4b 1073741824 Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Deleting offline snapshot 3b38e865-b84f-46d8-88de-436e81423468 of volume 7d889efc-0439-4add-bc9d-330b686d3b1a {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:29:36 devstack sudo[114013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] snapshot_file for this snap is: volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b93cba-ea62-45a3-ad54-a85a41485cfb]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Flow 'volume_create_manager' (ed87f834-0d1a-43d0-9e57-67ca5e6ed31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7e978b-2a50-463f-94d5-1157b28055ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7e978b-2a50-463f-94d5-1157b28055ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1044968232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d42c4b-31e9-4d28-9c95-6cebadc65fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f04f43a8ba43e38aa7390d2d86ec16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:36Z,use_quota=True,user_id='e7430d30e5ab48f99f831cf6ee907c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5adb53c7-b34a-4d43-8477-e7591b65be0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5adb53c7-b34a-4d43-8477-e7591b65be0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fa19be-e546-4715-879b-3d3b7755e70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fa19be-e546-4715-879b-3d3b7755e70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71d42c4b-31e9-4d28-9c95-6cebadc65fcc', 'volume_name': 'volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783c6c28-dbc1-4c20-95a2-9155363a7a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783c6c28-dbc1-4c20-95a2-9155363a7a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17680e4a-54d2-4824-bd0d-ef8fa813144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:36 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Volume 71d42c4b-31e9-4d28-9c95-6cebadc65fcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc', 'volume_size': 1} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:36 devstack sudo[114018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 Aug 26 16:29:36 devstack sudo[114018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:36 devstack sudo[114013]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:36 devstack sudo[114018]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d4a22740-b704-4277-9c14-a816fc335d4b 1073741824" returned: 0 in 0.439s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468" returned: 0 in 0.364s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d889efc-0439-4add-bc9d-330b686d3b1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcd80de-c39b-4a79-a21f-4e2c03d7c068]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d4a22740-b704-4277-9c14-a816fc335d4b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:36 devstack sudo[114027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d4a22740-b704-4277-9c14-a816fc335d4b Aug 26 16:29:36 devstack sudo[114027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:36 devstack sudo[114026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a Aug 26 16:29:36 devstack sudo[114026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:37 devstack sudo[114027]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d4a22740-b704-4277-9c14-a816fc335d4b" returned: 0 in 0.252s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.583s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1044968232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d42c4b-31e9-4d28-9c95-6cebadc65fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f04f43a8ba43e38aa7390d2d86ec16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:36Z,use_quota=True,user_id='e7430d30e5ab48f99f831cf6ee907c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Creating volume 71d42c4b-31e9-4d28-9c95-6cebadc65fcc {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:37 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6d899d-5207-40f4-98f1-3ee8ab7bdaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a22740-b704-4277-9c14-a816fc335d4b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec3fed8-1a24-48ce-9714-d629724a7c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:37 devstack sudo[114033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc 1073741824 Aug 26 16:29:37 devstack sudo[114033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:37 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume volume-d4a22740-b704-4277-9c14-a816fc335d4b (d4a22740-b704-4277-9c14-a816fc335d4b): created successfully Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec3fed8-1a24-48ce-9714-d629724a7c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Flow 'volume_create_manager' (d058ee69-f87c-462c-8a03-5ef7616ef660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-241b2211-14cf-41f1-a9c2-3abd5f8d46b7 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Created volume successfully. Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:37 devstack sudo[114026]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a" returned: 0 in 0.652s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:37 devstack sudo[114040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 Aug 26 16:29:37 devstack sudo[114040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:37 devstack sudo[114033]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc 1073741824" returned: 0 in 0.470s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:37 devstack sudo[114042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc Aug 26 16:29:37 devstack sudo[114042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:37 devstack sudo[114040]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468" returned: 0 in 0.332s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:37 devstack sudo[114047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468 Aug 26 16:29:37 devstack sudo[114047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:37 devstack sudo[114042]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc" returned: 0 in 0.250s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.442s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17680e4a-54d2-4824-bd0d-ef8fa813144d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f09b037-7927-4831-af5d-cd48ed8861ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] Creating offline snapshot 640e28df-4e28-4854-8d4a-c4c943afe83e of volume 9112c5d9-4a90-458a-88f8-fa15f6592013 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:29:37 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Volume volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc (71d42c4b-31e9-4d28-9c95-6cebadc65fcc): created successfully Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f09b037-7927-4831-af5d-cd48ed8861ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Flow 'volume_create_manager' (ed87f834-0d1a-43d0-9e57-67ca5e6ed31f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[6757f84e-52e5-45cf-b648-2f09d3fca712]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-03dc7c97-714e-4a03-a870-81a4bc5698d2 tempest-ProjectReaderTests-34953275 None] Created volume successfully. Aug 26 16:29:38 devstack sudo[114047]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a.3b38e865-b84f-46d8-88de-436e81423468" returned: 0 in 0.250s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:38 devstack sudo[114050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013 Aug 26 16:29:38 devstack sudo[114050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-quobyte-3b38e865-b84f-46d8-88de-436e81423468" released by "_delete_snapshot" :: held 1.708s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-quobyte-7d889efc-0439-4add-bc9d-330b686d3b1a" released by "delete_snapshot" :: held 1.739s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Created reservations ['5fe57356-ebfb-4028-a584-db2f65fefe19', '00e0c069-93f1-4ff1-90d2-9da25e971b1f', 'ab7c311b-fc99-488f-bfa8-ccffdd07bf30', 'cb92f905-342b-4e7e-b1e4-23960df677fc'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:38 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Delete snapshot completed successfully. Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-a7d4e1e4-cdc2-4546-926c-494e020b02c2 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-3b38e865-b84f-46d8-88de-436e81423468-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:38 devstack sudo[114050]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013" returned: 0 in 0.407s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:38 devstack sudo[114057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e 1G Aug 26 16:29:38 devstack sudo[114057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "cinder-7d889efc-0439-4add-bc9d-330b686d3b1a-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-7d889efc-0439-4add-bc9d-330b686d3b1a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "cinder-quobyte-7d889efc-0439-4add-bc9d-330b686d3b1a" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-quobyte-7d889efc-0439-4add-bc9d-330b686d3b1a" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[db83f8d3-4c77-41e0-bf72-8f0cf844685d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:38 devstack sudo[114059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a Aug 26 16:29:38 devstack sudo[114059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Acquiring lock "cinder-71d42c4b-31e9-4d28-9c95-6cebadc65fcc-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Lock "cinder-71d42c4b-31e9-4d28-9c95-6cebadc65fcc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:38 devstack sudo[114057]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e 1G" returned: 0 in 0.540s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9112c5d9-4a90-458a-88f8-fa15f6592013 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:38 devstack sudo[114067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9112c5d9-4a90-458a-88f8-fa15f6592013 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e Aug 26 16:29:38 devstack sudo[114067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Acquiring lock "cinder-quobyte-71d42c4b-31e9-4d28-9c95-6cebadc65fcc" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:38 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Lock "cinder-quobyte-71d42c4b-31e9-4d28-9c95-6cebadc65fcc" acquired by "delete_volume" :: waited 0.039s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cb985e-d375-444b-bc06-6998aaf118b3]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:39 devstack sudo[114059]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a" returned: 0 in 0.549s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:39 devstack sudo[114073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a Aug 26 16:29:39 devstack sudo[114073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Flow 'volume_create_manager' (6b4e6452-c7a4-481c-a0bb-4e5485915869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67b6ba9-c093-44b9-b155-47aa14ae27ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67b6ba9-c093-44b9-b155-47aa14ae27ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1472502892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f41e9f1-f140-4921-adc9-a2e41fda77ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7502c10e3f4b109622b849fb61cf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:39Z,use_quota=True,user_id='a6b1f613a4874699a14be85dc14ca3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7c69d4-9bcf-4751-8887-0ddc1ec6bb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:39 devstack sudo[114072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc Aug 26 16:29:39 devstack sudo[114072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7c69d4-9bcf-4751-8887-0ddc1ec6bb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f04f65-de8d-438e-8fe9-5444600b498b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f04f65-de8d-438e-8fe9-5444600b498b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f41e9f1-f140-4921-adc9-a2e41fda77ec', 'volume_name': 'volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e19b49c-3cc7-43c3-a727-22b994e5c919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e19b49c-3cc7-43c3-a727-22b994e5c919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdf0219-ac97-4d4c-8e38-b51aa0c359a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:39 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume 6f41e9f1-f140-4921-adc9-a2e41fda77ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec', 'volume_size': 1} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:39 devstack sudo[114067]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:39 devstack sudo[114073]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9112c5d9-4a90-458a-88f8-fa15f6592013 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e" returned: 0 in 0.517s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:39 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e is being set with open permissions: ugo+rw Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-7d889efc-0439-4add-bc9d-330b686d3b1a" returned: 0 in 0.322s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:39 devstack sudo[114080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e Aug 26 16:29:39 devstack sudo[114080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-quobyte-7d889efc-0439-4add-bc9d-330b686d3b1a" released by "delete_volume" :: held 0.979s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Flow 'volume_create_manager' (20e3f203-da34-417b-97f0-cfe84eb50448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:39 devstack sudo[114072]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469132f4-7f9a-49e3-bc7a-25c7408ed260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc" returned: 0 in 0.507s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:39 devstack sudo[114085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc Aug 26 16:29:39 devstack sudo[114085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469132f4-7f9a-49e3-bc7a-25c7408ed260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-988747167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7502c10e3f4b109622b849fb61cf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:39Z,use_quota=True,user_id='a6b1f613a4874699a14be85dc14ca3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c0078a-fb30-4f73-8495-9ab8ef7fc7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c0078a-fb30-4f73-8495-9ab8ef7fc7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b8d2d9-bd05-4bde-a326-cb872f39f2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b8d2d9-bd05-4bde-a326-cb872f39f2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b', 'volume_name': 'volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1747f312-6050-4822-ad11-c269e267cb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1747f312-6050-4822-ad11-c269e267cb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5340676-b931-487f-a7d0-2762991fd98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:39 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume 3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b', 'volume_size': 1} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Created reservations ['2c3a3e99-df9e-4b19-8ece-602d1012fc9e', 'd3413cd5-dfb5-47cc-911d-20a9bd54725c', '8f90b714-9387-424d-b546-91dc9b41de67', 'd5b3fa1b-801d-46e1-8b60-c2d9d575a78a'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:39 devstack sudo[114080]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e" returned: 0 in 0.359s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:39 devstack sudo[114088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:39 devstack sudo[114088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:39 devstack sudo[114089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.info Aug 26 16:29:39 devstack sudo[114089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:39 devstack sudo[114085]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-71d42c4b-31e9-4d28-9c95-6cebadc65fcc" returned: 0 in 0.388s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Lock "cinder-quobyte-71d42c4b-31e9-4d28-9c95-6cebadc65fcc" released by "delete_volume" :: held 0.961s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:39 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Flow 'volume_create_manager' (24cf38c9-74f6-45c7-b535-d724603b4814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e31a146-3291-4812-b4f2-6dd4a96845f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e31a146-3291-4812-b4f2-6dd4a96845f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-958972318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4657a460-6c3a-4601-aa50-0bd3909a26df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7502c10e3f4b109622b849fb61cf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:40Z,use_quota=True,user_id='a6b1f613a4874699a14be85dc14ca3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9f72cd-ef83-42ac-acf7-d1cdc8779fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9f72cd-ef83-42ac-acf7-d1cdc8779fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f22240-8258-4926-80d1-0cba566c9de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f22240-8258-4926-80d1-0cba566c9de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4657a460-6c3a-4601-aa50-0bd3909a26df', 'volume_name': 'volume-4657a460-6c3a-4601-aa50-0bd3909a26df', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a393b85-ad3f-408d-a6d0-c7a84b18ab54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a393b85-ad3f-408d-a6d0-c7a84b18ab54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:40 devstack sudo[114088]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40b76c2-0b4b-404c-9330-1cd509228ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:40 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume 4657a460-6c3a-4601-aa50-0bd3909a26df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4657a460-6c3a-4601-aa50-0bd3909a26df', 'volume_size': 1} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.357s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:40 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Deleted volume successfully. Aug 26 16:29:40 devstack sudo[114089]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.info" returned: 0 in 0.355s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:40 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.info is being set with open permissions: ugo+rw Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:40 devstack sudo[114095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.info Aug 26 16:29:40 devstack sudo[114095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-479a29a0-03bf-465b-ad8a-a05aeae70ca7 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-7d889efc-0439-4add-bc9d-330b686d3b1a-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Created reservations ['7a16904a-12cd-46e6-8e46-5b6d2b76bdad', '0324cadb-802d-4225-80fa-3218a891805d', '9d6e2a94-6489-4622-8133-f19568526ab3', '33370b95-2589-4f9e-bd90-eed59ff42634'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:40 devstack sudo[114097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:40 devstack sudo[114097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:40 devstack sudo[114095]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.info" returned: 0 in 0.305s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.218s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1472502892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f41e9f1-f140-4921-adc9-a2e41fda77ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7502c10e3f4b109622b849fb61cf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:39Z,use_quota=True,user_id='a6b1f613a4874699a14be85dc14ca3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Creating volume 6f41e9f1-f140-4921-adc9-a2e41fda77ec {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:40 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:40 devstack sudo[114100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec 1073741824 Aug 26 16:29:40 devstack sudo[114100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Flow 'volume_create_manager' (e117cf2d-46b3-420c-9290-7a5c8f23e936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3e88c8-4a5d-436f-a608-17388db8ac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:40 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8346d01c-ffd5-43cc-8335-527ac41cacc9 tempest-ProjectReaderTests-1638074044 None] Create snapshot completed successfully Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3e88c8-4a5d-436f-a608-17388db8ac68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2077874237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429495dd-a6b9-4763-8da4-1ad2c3c4b6b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7502c10e3f4b109622b849fb61cf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:40Z,use_quota=True,user_id='a6b1f613a4874699a14be85dc14ca3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:40 devstack sudo[114097]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cbf708-c87d-4228-8267-6c22b1f37774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cbf708-c87d-4228-8267-6c22b1f37774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9d603b-5166-49eb-a383-772a1e2d6163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9d603b-5166-49eb-a383-772a1e2d6163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429495dd-a6b9-4763-8da4-1ad2c3c4b6b8', 'volume_name': 'volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84c6fcf-9154-45fe-a04c-bb5a046cdaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84c6fcf-9154-45fe-a04c-bb5a046cdaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da770db5-46b7-4400-b970-9ce63fe1102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:40 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume 429495dd-a6b9-4763-8da4-1ad2c3c4b6b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8', 'volume_size': 1} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.340s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:40 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Deleted volume successfully. Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d6357ab5-ce72-42b2-865d-5fc4a062fb30 tempest-ProjectReaderTests-34953275 None] Lock "cinder-71d42c4b-31e9-4d28-9c95-6cebadc65fcc-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "cinder-2775d328-71bf-4ae8-af70-efde0d5e0918-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-2775d328-71bf-4ae8-af70-efde0d5e0918-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "cinder-quobyte-2775d328-71bf-4ae8-af70-efde0d5e0918" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-quobyte-2775d328-71bf-4ae8-af70-efde0d5e0918" acquired by "delete_volume" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e1ab1f-ada8-493d-8d2b-2da96e77146c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:41 devstack sudo[114105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918 Aug 26 16:29:41 devstack sudo[114105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Flow 'volume_create_manager' (84361766-941a-4fdd-9af0-02cf4648d231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8aca591-e98c-40cc-b51c-0f64258e3370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-640e28df-4e28-4854-8d4a-c4c943afe83e-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8aca591-e98c-40cc-b51c-0f64258e3370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1166504433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bef1022-3fad-47c2-9108-04d8260e6e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7502c10e3f4b109622b849fb61cf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:41Z,use_quota=True,user_id='a6b1f613a4874699a14be85dc14ca3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e545c1e-ec0c-4b5e-9882-a6499b9d3985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e545c1e-ec0c-4b5e-9882-a6499b9d3985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e21b34e-62b9-4304-8023-b8827dadcd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e21b34e-62b9-4304-8023-b8827dadcd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bef1022-3fad-47c2-9108-04d8260e6e60', 'volume_name': 'volume-6bef1022-3fad-47c2-9108-04d8260e6e60', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e376eb96-552f-4bc3-b95d-975eb82978c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:41 devstack sudo[114100]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e376eb96-552f-4bc3-b95d-975eb82978c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b41b13-5fec-48a5-a1a2-4096c4c46afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:41 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume 6bef1022-3fad-47c2-9108-04d8260e6e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bef1022-3fad-47c2-9108-04d8260e6e60', 'volume_size': 1} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec 1073741824" returned: 0 in 0.700s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-640e28df-4e28-4854-8d4a-c4c943afe83e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.094s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-9112c5d9-4a90-458a-88f8-fa15f6592013" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-9112c5d9-4a90-458a-88f8-fa15f6592013" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-640e28df-4e28-4854-8d4a-c4c943afe83e" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-640e28df-4e28-4854-8d4a-c4c943afe83e" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:41 devstack sudo[114110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Deleting offline snapshot 640e28df-4e28-4854-8d4a-c4c943afe83e of volume 9112c5d9-4a90-458a-88f8-fa15f6592013 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:29:41 devstack sudo[114110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] snapshot_file for this snap is: volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3876003-94aa-4359-b73f-2e26062fe538]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:41 devstack sudo[114105]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918" returned: 0 in 0.508s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:41 devstack sudo[114115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918 Aug 26 16:29:41 devstack sudo[114115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:41 devstack sudo[114114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e Aug 26 16:29:41 devstack sudo[114114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:41 devstack sudo[114110]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec" returned: 0 in 0.347s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.990s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-988747167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7502c10e3f4b109622b849fb61cf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:39Z,use_quota=True,user_id='a6b1f613a4874699a14be85dc14ca3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Creating volume 3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:41 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:41 devstack sudo[114120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b 1073741824 Aug 26 16:29:41 devstack sudo[114120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdf0219-ac97-4d4c-8e38-b51aa0c359a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d331b480-cfb9-48a3-8a70-8f4b7eb40261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:41 devstack sudo[114115]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2775d328-71bf-4ae8-af70-efde0d5e0918" returned: 0 in 0.324s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:41 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec (6f41e9f1-f140-4921-adc9-a2e41fda77ec): created successfully Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d331b480-cfb9-48a3-8a70-8f4b7eb40261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:41 devstack sudo[114114]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Flow 'volume_create_manager' (6b4e6452-c7a4-481c-a0bb-4e5485915869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-quobyte-2775d328-71bf-4ae8-af70-efde0d5e0918" released by "delete_volume" :: held 0.894s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e" returned: 0 in 0.416s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Flow 'volume_create_manager' (f2f03455-b18c-4324-823f-309d40657946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fad4d18-834e-41b9-81be-1005dbc4d11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9112c5d9-4a90-458a-88f8-fa15f6592013(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[425e02ef-f284-4874-916e-ce3426a383d3]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:41 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-55441faf-cfe8-4927-9066-a8a0944dff54 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Created volume successfully. Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fad4d18-834e-41b9-81be-1005dbc4d11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337573750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f04f43a8ba43e38aa7390d2d86ec16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:42Z,use_quota=True,user_id='e7430d30e5ab48f99f831cf6ee907c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c84fa62-1517-4c70-ac8b-6f385d7698a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c84fa62-1517-4c70-ac8b-6f385d7698a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e62dfc2-60db-4046-8973-92b7554af55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e62dfc2-60db-4046-8973-92b7554af55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d', 'volume_name': 'volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3668de-136d-4270-94c3-ce0744ec0bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3668de-136d-4270-94c3-ce0744ec0bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e593e1ac-4570-44d1-9741-695b4dc555d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:41 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Volume bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d', 'volume_size': 1} Aug 26 16:29:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:41 devstack sudo[114127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013 Aug 26 16:29:41 devstack sudo[114127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Created reservations ['de2fe124-26d0-4d19-9584-4a4654f0fb8d', 'ed5de371-b48c-4c19-aa66-185d1ceb93f0', '12873a84-2db3-4158-9013-d7ec7fa9a5ff', '09657969-9872-4ff3-bcff-5c8403c2a184'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:42 devstack sudo[114131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:42 devstack sudo[114131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:42 devstack sudo[114120]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b 1073741824" returned: 0 in 0.550s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:42 devstack sudo[114136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b Aug 26 16:29:42 devstack sudo[114136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:42 devstack sudo[114127]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013" returned: 0 in 0.418s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:42 devstack sudo[114139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e Aug 26 16:29:42 devstack sudo[114139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:42 devstack sudo[114131]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.263s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:42 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Deleted volume successfully. Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8af975ad-b831-429c-b873-8ed7ff70d2b0 tempest-VolumeDependencyTests-1712294153 None] Lock "cinder-2775d328-71bf-4ae8-af70-efde0d5e0918-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:42 devstack sudo[114136]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b" returned: 0 in 0.256s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.344s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-958972318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4657a460-6c3a-4601-aa50-0bd3909a26df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7502c10e3f4b109622b849fb61cf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:40Z,use_quota=True,user_id='a6b1f613a4874699a14be85dc14ca3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Creating volume 4657a460-6c3a-4601-aa50-0bd3909a26df {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:42 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4657a460-6c3a-4601-aa50-0bd3909a26df 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:42 devstack sudo[114143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4657a460-6c3a-4601-aa50-0bd3909a26df 1073741824 Aug 26 16:29:42 devstack sudo[114143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5340676-b931-487f-a7d0-2762991fd98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85af928e-098d-4060-ab2b-5255c05ccaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:42 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b (3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b): created successfully Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85af928e-098d-4060-ab2b-5255c05ccaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Flow 'volume_create_manager' (20e3f203-da34-417b-97f0-cfe84eb50448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:42 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-94dfcf0c-d9f2-4488-ad4a-aa906ee9e39a tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Created volume successfully. Aug 26 16:29:42 devstack sudo[114139]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e" returned: 0 in 0.397s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:42 devstack sudo[114148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e Aug 26 16:29:42 devstack sudo[114148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:42 devstack sudo[114143]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4657a460-6c3a-4601-aa50-0bd3909a26df 1073741824" returned: 0 in 0.447s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:42 devstack sudo[114148]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013.640e28df-4e28-4854-8d4a-c4c943afe83e" returned: 0 in 0.265s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-640e28df-4e28-4854-8d4a-c4c943afe83e" released by "_delete_snapshot" :: held 1.697s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-9112c5d9-4a90-458a-88f8-fa15f6592013" released by "delete_snapshot" :: held 1.758s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4657a460-6c3a-4601-aa50-0bd3909a26df {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:43 devstack sudo[114155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4657a460-6c3a-4601-aa50-0bd3909a26df Aug 26 16:29:43 devstack sudo[114155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Created reservations ['5ae2e478-625f-4c49-a73c-45c60c7b0b97', '47f7e19e-92fd-453a-a7cf-c54ce17e58df', '4f1fb772-8e27-49f3-9abb-c07f3d409029', '7202e164-ffa0-4b9a-9835-5e49b26b60af'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:43 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Delete snapshot completed successfully. Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6e9b4d86-163e-42c4-bb9d-02c057dbdf37 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-640e28df-4e28-4854-8d4a-c4c943afe83e-delete_snapshot" released by "delete_snapshot" :: held 1.960s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-9112c5d9-4a90-458a-88f8-fa15f6592013-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:43 devstack sudo[114155]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4657a460-6c3a-4601-aa50-0bd3909a26df" returned: 0 in 0.287s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Lock "cinder-9112c5d9-4a90-458a-88f8-fa15f6592013-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.643s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2077874237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429495dd-a6b9-4763-8da4-1ad2c3c4b6b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7502c10e3f4b109622b849fb61cf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:40Z,use_quota=True,user_id='a6b1f613a4874699a14be85dc14ca3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Creating volume 429495dd-a6b9-4763-8da4-1ad2c3c4b6b8 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:43 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:43 devstack sudo[114158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8 1073741824 Aug 26 16:29:43 devstack sudo[114158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40b76c2-0b4b-404c-9330-1cd509228ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4657a460-6c3a-4601-aa50-0bd3909a26df', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bace0148-009c-4bba-9460-c7eef1e128f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:43 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume volume-4657a460-6c3a-4601-aa50-0bd3909a26df (4657a460-6c3a-4601-aa50-0bd3909a26df): created successfully Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bace0148-009c-4bba-9460-c7eef1e128f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Flow 'volume_create_manager' (24cf38c9-74f6-45c7-b535-d724603b4814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:43 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-83e24fda-ed4d-4400-83ba-bc834e0c786c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Created volume successfully. Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-9112c5d9-4a90-458a-88f8-fa15f6592013" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-9112c5d9-4a90-458a-88f8-fa15f6592013" acquired by "delete_volume" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9ea429-312b-45db-ac4c-7955791c8519]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:43 devstack sudo[114160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013 Aug 26 16:29:43 devstack sudo[114160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:43 devstack sudo[114158]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8 1073741824" returned: 0 in 0.537s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:43 devstack sudo[114160]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013" returned: 0 in 0.405s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:43 devstack sudo[114168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013 Aug 26 16:29:43 devstack sudo[114168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:43 devstack sudo[114170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8 Aug 26 16:29:43 devstack sudo[114170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:44 devstack sudo[114168]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9112c5d9-4a90-458a-88f8-fa15f6592013" returned: 0 in 0.321s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:44 devstack sudo[114170]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8" returned: 0 in 0.290s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.039s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1166504433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bef1022-3fad-47c2-9108-04d8260e6e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7502c10e3f4b109622b849fb61cf7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:41Z,use_quota=True,user_id='a6b1f613a4874699a14be85dc14ca3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Creating volume 6bef1022-3fad-47c2-9108-04d8260e6e60 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:44 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6bef1022-3fad-47c2-9108-04d8260e6e60 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-9112c5d9-4a90-458a-88f8-fa15f6592013" released by "delete_volume" :: held 0.827s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:44 devstack sudo[114174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6bef1022-3fad-47c2-9108-04d8260e6e60 1073741824 Aug 26 16:29:44 devstack sudo[114174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da770db5-46b7-4400-b970-9ce63fe1102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5485008a-30c4-4620-a893-44a26c2fd1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:44 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8 (429495dd-a6b9-4763-8da4-1ad2c3c4b6b8): created successfully Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5485008a-30c4-4620-a893-44a26c2fd1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Flow 'volume_create_manager' (e117cf2d-46b3-420c-9290-7a5c8f23e936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:44 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5336e570-8169-43ac-8d50-60b2d883a7a0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Created volume successfully. Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Created reservations ['c62380cb-2190-4999-95c0-6a2322ef0a8c', 'f93472e7-3143-42e2-a59e-98693fd68537', '5d6e74bf-6f3c-4648-bac5-7d681b318176', 'f2c3c557-6d42-4bf7-be7d-300964d60381'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:44 devstack sudo[114178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:44 devstack sudo[114178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:44 devstack sudo[114178]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.298s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:44 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Deleted volume successfully. Aug 26 16:29:44 devstack sudo[114174]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6bef1022-3fad-47c2-9108-04d8260e6e60 1073741824" returned: 0 in 0.587s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eaec1dee-ecde-4a4f-ad11-2f53de095b4d tempest-ProjectReaderTests-1638074044 None] Lock "cinder-9112c5d9-4a90-458a-88f8-fa15f6592013-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6bef1022-3fad-47c2-9108-04d8260e6e60 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:44 devstack sudo[114186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6bef1022-3fad-47c2-9108-04d8260e6e60 Aug 26 16:29:44 devstack sudo[114186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:45 devstack sudo[114186]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6bef1022-3fad-47c2-9108-04d8260e6e60" returned: 0 in 0.263s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.186s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337573750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f04f43a8ba43e38aa7390d2d86ec16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:42Z,use_quota=True,user_id='e7430d30e5ab48f99f831cf6ee907c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Creating volume bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:45 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b41b13-5fec-48a5-a1a2-4096c4c46afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bef1022-3fad-47c2-9108-04d8260e6e60', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3351c7-a455-4a4a-902f-202f2bf760cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:45 devstack sudo[114189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d 1073741824 Aug 26 16:29:45 devstack sudo[114189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:45 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Volume volume-6bef1022-3fad-47c2-9108-04d8260e6e60 (6bef1022-3fad-47c2-9108-04d8260e6e60): created successfully Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3351c7-a455-4a4a-902f-202f2bf760cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Flow 'volume_create_manager' (84361766-941a-4fdd-9af0-02cf4648d231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:45 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ce6db36a-0312-43bd-b534-abeee31d4bfa tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Created volume successfully. Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "cinder-6bef1022-3fad-47c2-9108-04d8260e6e60-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-6bef1022-3fad-47c2-9108-04d8260e6e60-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:45 devstack sudo[114189]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d 1073741824" returned: 0 in 0.503s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "cinder-quobyte-6bef1022-3fad-47c2-9108-04d8260e6e60" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-quobyte-6bef1022-3fad-47c2-9108-04d8260e6e60" acquired by "delete_volume" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:45 devstack sudo[114195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d Aug 26 16:29:45 devstack sudo[114195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1df9fa-db08-468f-b573-b133617039ac]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6bef1022-3fad-47c2-9108-04d8260e6e60 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:45 devstack sudo[114197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6bef1022-3fad-47c2-9108-04d8260e6e60 Aug 26 16:29:45 devstack sudo[114197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:46 devstack sudo[114195]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d" returned: 0 in 0.363s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e593e1ac-4570-44d1-9741-695b4dc555d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d38abee-a01b-4768-bf58-661048868f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:46 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Volume volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d (bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d): created successfully Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d38abee-a01b-4768-bf58-661048868f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Flow 'volume_create_manager' (f2f03455-b18c-4324-823f-309d40657946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:46 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-cca7d7bd-1689-401e-993f-30845c76dd1e tempest-ProjectReaderTests-34953275 None] Created volume successfully. Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Flow 'volume_create_manager' (d5c684db-a91c-485e-8db7-e7e3edf784f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d24adb-df07-4a8a-b2ed-dfd08e74391d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d24adb-df07-4a8a-b2ed-dfd08e74391d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-391346273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4414fc4a-8bc7-4b8e-b671-3729b11e83f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094516a040fc46c9b0bf6405b1ade1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:46Z,use_quota=True,user_id='b8524ea575bc43c3942aadee8c091467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e0a0bc-a83d-4017-839a-4e3e1e5dbff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e0a0bc-a83d-4017-839a-4e3e1e5dbff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:46 devstack sudo[114197]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87061173-d87c-4a6a-ad67-535448ee740d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87061173-d87c-4a6a-ad67-535448ee740d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4414fc4a-8bc7-4b8e-b671-3729b11e83f9', 'volume_name': 'volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98c4e77-684a-4ff2-981a-9bd1db118c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98c4e77-684a-4ff2-981a-9bd1db118c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49386419-e463-4085-80a3-e4aa735ad343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:46 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Volume 4414fc4a-8bc7-4b8e-b671-3729b11e83f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9', 'volume_size': 1} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-391346273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4414fc4a-8bc7-4b8e-b671-3729b11e83f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094516a040fc46c9b0bf6405b1ade1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:46Z,use_quota=True,user_id='b8524ea575bc43c3942aadee8c091467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Creating volume 4414fc4a-8bc7-4b8e-b671-3729b11e83f9 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:46 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6bef1022-3fad-47c2-9108-04d8260e6e60" returned: 0 in 0.557s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6bef1022-3fad-47c2-9108-04d8260e6e60 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:46 devstack sudo[114203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 1073741824 Aug 26 16:29:46 devstack sudo[114203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:46 devstack sudo[114204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6bef1022-3fad-47c2-9108-04d8260e6e60 Aug 26 16:29:46 devstack sudo[114204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Flow 'volume_create_manager' (00badd98-21c5-47ff-a958-eb5f8347a580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60a2cd6-19ab-416e-ae4c-73947242382f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:46 devstack sudo[114204]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6bef1022-3fad-47c2-9108-04d8260e6e60" returned: 0 in 0.287s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60a2cd6-19ab-416e-ae4c-73947242382f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab641059-482c-48a3-ab87-c196f0c73760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da23b55e96d14b6a835774613fe42c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:47Z,use_quota=True,user_id='6c9c25be86504288878298efc8d73dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1740ee8-0077-44f0-806a-17445b15f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1740ee8-0077-44f0-806a-17445b15f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737b89f6-87a1-489a-86cd-f5559b35e981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737b89f6-87a1-489a-86cd-f5559b35e981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab641059-482c-48a3-ab87-c196f0c73760', 'volume_name': 'volume-ab641059-482c-48a3-ab87-c196f0c73760', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9502a0-636d-4ea7-98f3-0e780acc760c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9502a0-636d-4ea7-98f3-0e780acc760c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f7e988-f3b3-4ab4-8187-7c2d09b415e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:46 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Volume ab641059-482c-48a3-ab87-c196f0c73760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab641059-482c-48a3-ab87-c196f0c73760', 'volume_size': 1} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-quobyte-6bef1022-3fad-47c2-9108-04d8260e6e60" released by "delete_volume" :: held 0.944s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Created reservations ['13e1a1ef-5e8c-4e9d-bd07-04deb7b0a930', '49f71b5f-b755-43c2-bcf0-f56f6c6d6851', 'ae3c1dd3-7e14-4f01-bfb3-d7fa551c652d', '171b37fc-7584-40a6-82d1-35865d12b4d9'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:46 devstack sudo[114203]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 1073741824" returned: 0 in 0.527s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:46 devstack sudo[114212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:46 devstack sudo[114212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:46 devstack sudo[114214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 Aug 26 16:29:46 devstack sudo[114214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:47 devstack sudo[114212]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.256s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:47 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Deleted volume successfully. Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-5a927ce5-0bf9-405c-a5d9-2e9c84bab92c tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-6bef1022-3fad-47c2-9108-04d8260e6e60-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:47 devstack sudo[114214]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9" returned: 0 in 0.271s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.481s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab641059-482c-48a3-ab87-c196f0c73760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da23b55e96d14b6a835774613fe42c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:47Z,use_quota=True,user_id='6c9c25be86504288878298efc8d73dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Creating volume ab641059-482c-48a3-ab87-c196f0c73760 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:47 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab641059-482c-48a3-ab87-c196f0c73760 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49386419-e463-4085-80a3-e4aa735ad343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1febe78a-6eda-47ee-beb0-cc9e4152b086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:47 devstack sudo[114218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab641059-482c-48a3-ab87-c196f0c73760 1073741824 Aug 26 16:29:47 devstack sudo[114218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:47 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Volume volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 (4414fc4a-8bc7-4b8e-b671-3729b11e83f9): created successfully Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1febe78a-6eda-47ee-beb0-cc9e4152b086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Flow 'volume_create_manager' (d5c684db-a91c-485e-8db7-e7e3edf784f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Acquiring lock "cinder-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:47 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-cf0c10c2-3276-45b1-ba64-6218bdbdc2f7 tempest-ProjectReaderTests-1638074044 None] Created volume successfully. Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Lock "cinder-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Acquiring lock "cinder-quobyte-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Lock "cinder-quobyte-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d" acquired by "delete_volume" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f475e0-6f5b-41ba-bd1d-3c318d1a939f]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:47 devstack sudo[114220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d Aug 26 16:29:47 devstack sudo[114220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:47 devstack sudo[114218]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab641059-482c-48a3-ab87-c196f0c73760 1073741824" returned: 0 in 0.515s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab641059-482c-48a3-ab87-c196f0c73760 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:47 devstack sudo[114220]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d" returned: 0 in 0.413s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:47 devstack sudo[114229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab641059-482c-48a3-ab87-c196f0c73760 Aug 26 16:29:47 devstack sudo[114229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:47 devstack sudo[114231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d Aug 26 16:29:47 devstack sudo[114231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "cinder-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "cinder-quobyte-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-quobyte-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:47 devstack sudo[114229]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab641059-482c-48a3-ab87-c196f0c73760" returned: 0 in 0.266s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f7e988-f3b3-4ab4-8187-7c2d09b415e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab641059-482c-48a3-ab87-c196f0c73760', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6df9d6-c973-45cd-9b6d-400df917314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4efa7a6-f04a-4f1b-b271-a2c1adf3f7ae]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:48 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Volume volume-ab641059-482c-48a3-ab87-c196f0c73760 (ab641059-482c-48a3-ab87-c196f0c73760): created successfully Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6df9d6-c973-45cd-9b6d-400df917314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:48 devstack sudo[114231]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Flow 'volume_create_manager' (00badd98-21c5-47ff-a958-eb5f8347a580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d" returned: 0 in 0.306s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Lock "cinder-quobyte-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d" released by "delete_volume" :: held 0.764s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:48 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2dcea388-0252-4881-9987-305464673361 tempest-CinderUnicodeTest-725567469 None] Created volume successfully. Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Created reservations ['89d11d1a-da8c-4409-8815-a8afd6a415f3', '66e8517f-345a-4aaa-9909-203804ec1aad', '46b91dc1-a0a9-4622-9c87-cffbd34369ab', '5556de93-ccf5-4929-a479-ecf60ef59e08'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:48 devstack sudo[114235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8 Aug 26 16:29:48 devstack sudo[114235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:48 devstack sudo[114237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:48 devstack sudo[114237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:48 devstack sudo[114237]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.252s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:48 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Deleted volume successfully. Aug 26 16:29:48 devstack sudo[114235]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8" returned: 0 in 0.458s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:48 devstack sudo[114243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8 Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-819b5b20-57dd-44e8-b598-1510fe011cac tempest-ProjectReaderTests-34953275 None] Lock "cinder-bbe51f78-b8ed-4f4d-a4fc-1618e83f1d1d-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:48 devstack sudo[114243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] Creating offline snapshot 3e7d9b81-d815-4c50-8779-1d85b456e18d of volume 4414fc4a-8bc7-4b8e-b671-3729b11e83f9 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e16dc6-10cc-45cf-8ce8-35591c4830d2]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:48 devstack sudo[114245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 Aug 26 16:29:48 devstack sudo[114245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:48 devstack sudo[114243]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8" returned: 0 in 0.318s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-quobyte-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8" released by "delete_volume" :: held 0.842s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Created reservations ['ea33a071-dbaa-4fb8-9206-bbdf105aeba8', '224227cb-eb49-4055-a095-9413a1f83c46', '5474f82c-ccf4-42a2-bf2e-4571c5c3db38', 'b32fbff5-cadf-49c3-9d16-fc6a53767fd4'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:49 devstack sudo[114251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:49 devstack sudo[114245]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:49 devstack sudo[114251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9" returned: 0 in 0.505s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:49 devstack sudo[114253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d 1G Aug 26 16:29:49 devstack sudo[114253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "cinder-4657a460-6c3a-4601-aa50-0bd3909a26df-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-4657a460-6c3a-4601-aa50-0bd3909a26df-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "cinder-quobyte-4657a460-6c3a-4601-aa50-0bd3909a26df" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-quobyte-4657a460-6c3a-4601-aa50-0bd3909a26df" acquired by "delete_volume" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ce424-28f5-4b10-bfa6-3632fb4f7336]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4657a460-6c3a-4601-aa50-0bd3909a26df {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:49 devstack sudo[114251]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.449s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:49 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Deleted volume successfully. Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-263d4294-2545-4b2b-8441-47b2ea500ff0 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-429495dd-a6b9-4763-8da4-1ad2c3c4b6b8-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Flow 'volume_create_manager' (4e1d82f8-5e4f-4758-9742-ff09d50a047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f893d2fb-e2ba-434a-957a-b9a2175239ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:49 devstack sudo[114256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4657a460-6c3a-4601-aa50-0bd3909a26df Aug 26 16:29:49 devstack sudo[114256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f893d2fb-e2ba-434a-957a-b9a2175239ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-570081318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da23b55e96d14b6a835774613fe42c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:49Z,use_quota=True,user_id='6c9c25be86504288878298efc8d73dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61e58b5-c9cd-4a44-aeca-96a1890594b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61e58b5-c9cd-4a44-aeca-96a1890594b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb5f583-a59a-4326-b01a-655e55a49ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb5f583-a59a-4326-b01a-655e55a49ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf', 'volume_name': 'volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed0859d-2187-456d-8da5-ac37e462041e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed0859d-2187-456d-8da5-ac37e462041e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad55bc1-cb73-4f7c-8bc8-6de112431011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:49 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Volume eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf', 'volume_size': 1} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:49 devstack sudo[114253]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d 1G" returned: 0 in 0.640s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:49 devstack sudo[114262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d Aug 26 16:29:49 devstack sudo[114262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:49 devstack sudo[114256]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4657a460-6c3a-4601-aa50-0bd3909a26df" returned: 0 in 0.429s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4657a460-6c3a-4601-aa50-0bd3909a26df {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:49 devstack sudo[114267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4657a460-6c3a-4601-aa50-0bd3909a26df Aug 26 16:29:49 devstack sudo[114267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:50 devstack sudo[114262]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d" returned: 0 in 0.334s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:50 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d is being set with open permissions: ugo+rw Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:50 devstack sudo[114272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d Aug 26 16:29:50 devstack sudo[114272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:50 devstack sudo[114267]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4657a460-6c3a-4601-aa50-0bd3909a26df" returned: 0 in 0.307s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-quobyte-4657a460-6c3a-4601-aa50-0bd3909a26df" released by "delete_volume" :: held 0.806s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Created reservations ['d17c27d1-9806-4340-bcd5-c576fd04a6a1', 'cbd4a1fd-d756-46ee-9a0d-4031123ed1b4', '9b84e524-2bfb-4547-a6d3-e7c005515926', '86b7afd9-6d00-4729-8a01-70c90e38a2d6'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:50 devstack sudo[114272]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d" returned: 0 in 0.275s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:50 devstack sudo[114276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:50 devstack sudo[114276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:50 devstack sudo[114278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.info Aug 26 16:29:50 devstack sudo[114278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "cinder-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "cinder-quobyte-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-quobyte-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcc20d4-b0fc-4058-b25c-892584f4b7fb]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:50 devstack sudo[114278]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.info" returned: 0 in 0.340s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:50 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.info is being set with open permissions: ugo+rw Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:50 devstack sudo[114276]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.411s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:50 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Deleted volume successfully. Aug 26 16:29:50 devstack sudo[114283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.info Aug 26 16:29:50 devstack sudo[114283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-e14311bc-7b8e-43ea-8386-5613c981779e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-4657a460-6c3a-4601-aa50-0bd3909a26df-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:50 devstack sudo[114282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b Aug 26 16:29:50 devstack sudo[114282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:50 devstack sudo[114283]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.info" returned: 0 in 0.256s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-570081318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da23b55e96d14b6a835774613fe42c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:49Z,use_quota=True,user_id='6c9c25be86504288878298efc8d73dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Creating volume eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:50 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:51 devstack sudo[114289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf 1073741824 Aug 26 16:29:51 devstack sudo[114289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a20660d3-6bf6-473b-99b9-26a3fb75083d tempest-ProjectReaderTests-1638074044 None] Create snapshot completed successfully Aug 26 16:29:51 devstack sudo[114282]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b" returned: 0 in 0.445s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:51 devstack sudo[114292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b Aug 26 16:29:51 devstack sudo[114292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:51 devstack sudo[114292]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b" returned: 0 in 0.270s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-quobyte-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b" released by "delete_volume" :: held 0.767s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Created reservations ['f1b74f4d-4165-4889-81ee-ae10f9a5532d', '2e8c8041-e4b7-45b4-a3b3-f07cb6de1f42', 'abccfd25-6742-4072-baf3-2360e70f26cc', '4243953f-8d65-4596-b28e-a3da4be8163f'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:51 devstack sudo[114289]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf 1073741824" returned: 0 in 0.488s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:51 devstack sudo[114299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:51 devstack sudo[114299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:51 devstack sudo[114300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf Aug 26 16:29:51 devstack sudo[114300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-3e7d9b81-d815-4c50-8779-1d85b456e18d-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Lock "cinder-3e7d9b81-d815-4c50-8779-1d85b456e18d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-4414fc4a-8bc7-4b8e-b671-3729b11e83f9" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "cinder-6f41e9f1-f140-4921-adc9-a2e41fda77ec-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-4414fc4a-8bc7-4b8e-b671-3729b11e83f9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-3e7d9b81-d815-4c50-8779-1d85b456e18d" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-6f41e9f1-f140-4921-adc9-a2e41fda77ec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-3e7d9b81-d815-4c50-8779-1d85b456e18d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Deleting offline snapshot 3e7d9b81-d815-4c50-8779-1d85b456e18d of volume 4414fc4a-8bc7-4b8e-b671-3729b11e83f9 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] snapshot_file for this snap is: volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64a4d40-0462-4192-94ea-40b30f86fae7]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:51 devstack sudo[114300]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf" returned: 0 in 0.339s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "cinder-quobyte-6f41e9f1-f140-4921-adc9-a2e41fda77ec" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad55bc1-cb73-4f7c-8bc8-6de112431011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11612fc3-2d7b-45ab-b984-27c735b97167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-quobyte-6f41e9f1-f140-4921-adc9-a2e41fda77ec" acquired by "delete_volume" :: waited 0.033s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:51 devstack sudo[114299]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.409s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:51 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Deleted volume successfully. Aug 26 16:29:51 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Volume volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf (eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf): created successfully Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11612fc3-2d7b-45ab-b984-27c735b97167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Flow 'volume_create_manager' (4e1d82f8-5e4f-4758-9742-ff09d50a047d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1faa19c-bb1a-4b68-b23d-165f44c3f87a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eebf4ae6-da3f-4e5f-878c-8be6155f73ac tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-3e52bce9-a45b-4451-9aa1-b4a9f4e62f3b-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:52 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7604d238-428f-44ff-a97d-ceab1223c5fc tempest-CinderUnicodeTest-725567469 None] Created volume successfully. Aug 26 16:29:52 devstack sudo[114304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d Aug 26 16:29:52 devstack sudo[114304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:52 devstack sudo[114306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec Aug 26 16:29:52 devstack sudo[114306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:52 devstack sudo[114304]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d" returned: 0 in 0.454s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[358fcbbe-4961-4441-9158-6d3025be0667]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:52 devstack sudo[114306]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec" returned: 0 in 0.423s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:52 devstack sudo[114316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec Aug 26 16:29:52 devstack sudo[114316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:52 devstack sudo[114314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 Aug 26 16:29:52 devstack sudo[114314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:52 devstack sudo[114316]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-6f41e9f1-f140-4921-adc9-a2e41fda77ec" returned: 0 in 0.303s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-quobyte-6f41e9f1-f140-4921-adc9-a2e41fda77ec" released by "delete_volume" :: held 0.828s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:52 devstack sudo[114314]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9" returned: 0 in 0.477s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Created reservations ['8457d505-89d3-470a-8dda-192b23eaaa45', '565ffc3a-d32f-4371-bebe-34051d5dc96e', '5725589b-c5f3-46e9-a359-6032315e2b15', 'e5d16953-880d-4912-8a4b-8a3c604edd07'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:52 devstack sudo[114323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d Aug 26 16:29:52 devstack sudo[114323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:52 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "cinder-d4a22740-b704-4277-9c14-a816fc335d4b-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:53 devstack sudo[114325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:53 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-d4a22740-b704-4277-9c14-a816fc335d4b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] Creating offline snapshot 4a6dabe3-0b1b-45b4-9cb5-e541d081b507 of volume eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "cinder-quobyte-d4a22740-b704-4277-9c14-a816fc335d4b" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[545ec193-f00e-4bbe-83c2-915c25a7797e]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-quobyte-d4a22740-b704-4277-9c14-a816fc335d4b" acquired by "delete_volume" :: waited 0.051s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b7c4c2-70dc-4843-80cf-685babaff8dd]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d4a22740-b704-4277-9c14-a816fc335d4b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:53 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.296s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:53 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Deleted volume successfully. Aug 26 16:29:53 devstack sudo[114327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf Aug 26 16:29:53 devstack sudo[114327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2c447c53-b7c1-4da0-ba0e-57b9da14df97 tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-6f41e9f1-f140-4921-adc9-a2e41fda77ec-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:53 devstack sudo[114332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d4a22740-b704-4277-9c14-a816fc335d4b Aug 26 16:29:53 devstack sudo[114332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:53 devstack sudo[114323]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d" returned: 0 in 0.669s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:53 devstack sudo[114335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d Aug 26 16:29:53 devstack sudo[114335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:53 devstack sudo[114327]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf" returned: 0 in 0.503s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:53 devstack sudo[114341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 1G Aug 26 16:29:53 devstack sudo[114341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:53 devstack sudo[114332]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d4a22740-b704-4277-9c14-a816fc335d4b" returned: 0 in 0.562s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d4a22740-b704-4277-9c14-a816fc335d4b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:53 devstack sudo[114335]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9.3e7d9b81-d815-4c50-8779-1d85b456e18d" returned: 0 in 0.347s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:53 devstack sudo[114346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d4a22740-b704-4277-9c14-a816fc335d4b Aug 26 16:29:53 devstack sudo[114346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-3e7d9b81-d815-4c50-8779-1d85b456e18d" released by "_delete_snapshot" :: held 2.105s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-4414fc4a-8bc7-4b8e-b671-3729b11e83f9" released by "delete_snapshot" :: held 2.147s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:53 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Created reservations ['42c62640-059a-48d3-a613-cfdec55571bb', '426049a7-b2e5-4eb5-b5b6-df3dacda6537', 'e3178771-2acd-4922-9c6e-48c867f17502', '0267b38a-6e72-4407-abce-9573345c7c6d'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:54 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Delete snapshot completed successfully. Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-544ca893-5a90-4126-b25a-f5d343afb23e tempest-ProjectReaderTests-1638074044 None] Lock "cinder-3e7d9b81-d815-4c50-8779-1d85b456e18d-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:54 devstack sudo[114346]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-d4a22740-b704-4277-9c14-a816fc335d4b" returned: 0 in 0.343s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-quobyte-d4a22740-b704-4277-9c14-a816fc335d4b" released by "delete_volume" :: held 0.969s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Created reservations ['8373d5a1-3775-4cd5-851f-2fd2e2216d0c', 'c3cc2ee6-dec9-42f1-9d24-da2034814919', 'ae238352-485e-4aff-841c-f09b6a648a4a', '20352e6c-3824-45a5-8d54-fa9ed954912f'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:54 devstack sudo[114341]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 1G" returned: 0 in 0.576s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:54 devstack sudo[114352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 Aug 26 16:29:54 devstack sudo[114352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:54 devstack sudo[114354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:54 devstack sudo[114354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:54 devstack sudo[114354]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.244s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:54 devstack sudo[114352]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507" returned: 0 in 0.320s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:54 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 is being set with open permissions: ugo+rw Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:54 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Deleted volume successfully. Aug 26 16:29:54 devstack sudo[114360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 Aug 26 16:29:54 devstack sudo[114360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-6a7e5438-e8b1-4f30-92af-7e75f5c4af4e tempest-CreateVolumesFromSourceVolumeTest-1103492144 None] Lock "cinder-d4a22740-b704-4277-9c14-a816fc335d4b-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:54 devstack sudo[114360]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507" returned: 0 in 0.284s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-4414fc4a-8bc7-4b8e-b671-3729b11e83f9-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:54 devstack sudo[114364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.info Aug 26 16:29:54 devstack sudo[114364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-4414fc4a-8bc7-4b8e-b671-3729b11e83f9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-4414fc4a-8bc7-4b8e-b671-3729b11e83f9" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-4414fc4a-8bc7-4b8e-b671-3729b11e83f9" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:55 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c6abf0-2265-4130-8e38-87aec9e4aac2]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:55 devstack sudo[114364]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.info" returned: 0 in 0.289s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:55 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.info is being set with open permissions: ugo+rw Aug 26 16:29:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:55 devstack sudo[114366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 Aug 26 16:29:55 devstack sudo[114366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:55 devstack sudo[114368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.info Aug 26 16:29:55 devstack sudo[114368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:55 devstack sudo[114368]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.info" returned: 0 in 0.285s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-cd7d89ce-2e98-41f4-ba3b-ba5b564aa3ed tempest-CinderUnicodeTest-725567469 None] Create snapshot completed successfully Aug 26 16:29:55 devstack sudo[114366]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9" returned: 0 in 0.451s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:55 devstack sudo[114376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9 Aug 26 16:29:55 devstack sudo[114376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:55 devstack sudo[114376]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-4414fc4a-8bc7-4b8e-b671-3729b11e83f9" returned: 0 in 0.270s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:55 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-4414fc4a-8bc7-4b8e-b671-3729b11e83f9" released by "delete_volume" :: held 0.794s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:55 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Created reservations ['5aa4420f-7653-4d35-a5e6-0ead20b6b6b3', '454bed09-7832-43ff-ac63-480f37d2fae9', '5ea82ce8-3074-4a28-bbc4-29c75c6a9628', '28d0cd7c-5794-489c-a445-4b088a679aad'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:56 devstack sudo[114379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:29:56 devstack sudo[114379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Acquiring lock "cinder-4a6dabe3-0b1b-45b4-9cb5-e541d081b507-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Lock "cinder-4a6dabe3-0b1b-45b4-9cb5-e541d081b507-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Acquiring lock "cinder-quobyte-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Lock "cinder-quobyte-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf" acquired by "delete_snapshot" :: waited 0.048s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Acquiring lock "cinder-quobyte-4a6dabe3-0b1b-45b4-9cb5-e541d081b507" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Lock "cinder-quobyte-4a6dabe3-0b1b-45b4-9cb5-e541d081b507" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Deleting offline snapshot 4a6dabe3-0b1b-45b4-9cb5-e541d081b507 of volume eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] snapshot_file for this snap is: volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[131c1f6c-b9ea-4d43-ad6e-a656804be004]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:56 devstack sudo[114379]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.558s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:29:56 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Deleted volume successfully. Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-def3bc10-8816-48c4-8f3c-09b4bc555f44 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-4414fc4a-8bc7-4b8e-b671-3729b11e83f9-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:56 devstack sudo[114384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 Aug 26 16:29:56 devstack sudo[114384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:56 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Flow 'volume_create_manager' (725fec14-dfa4-461d-8c6a-61367a03a1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8111317a-b0b2-4632-883d-3e8236e39fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:57 devstack sudo[114384]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507" returned: 0 in 0.485s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8111317a-b0b2-4632-883d-3e8236e39fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-74890310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d79f6f1-d22e-4ced-b572-18ab8d80ab3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094516a040fc46c9b0bf6405b1ade1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:57Z,use_quota=True,user_id='b8524ea575bc43c3942aadee8c091467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13af66b7-59c8-426e-a9ac-4600525e05de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13af66b7-59c8-426e-a9ac-4600525e05de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa704cb2-7555-4520-9725-00ec08e4befe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa704cb2-7555-4520-9725-00ec08e4befe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d79f6f1-d22e-4ced-b572-18ab8d80ab3e', 'volume_name': 'volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbb9343-90c9-441b-8529-6a9195467216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbb9343-90c9-441b-8529-6a9195467216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb95f43-3568-41f2-9f07-056695af17ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:57 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Volume 8d79f6f1-d22e-4ced-b572-18ab8d80ab3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e', 'volume_size': 1} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-74890310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d79f6f1-d22e-4ced-b572-18ab8d80ab3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094516a040fc46c9b0bf6405b1ade1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:29:57Z,use_quota=True,user_id='b8524ea575bc43c3942aadee8c091467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Creating volume 8d79f6f1-d22e-4ced-b572-18ab8d80ab3e {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:29:57 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba34fa75-1442-4e19-8207-78d2a5754d49]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:57 devstack sudo[114389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e 1073741824 Aug 26 16:29:57 devstack sudo[114389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:57 devstack sudo[114390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf Aug 26 16:29:57 devstack sudo[114390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:57 devstack sudo[114390]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf" returned: 0 in 0.409s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:57 devstack sudo[114400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 Aug 26 16:29:57 devstack sudo[114400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:57 devstack sudo[114389]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e 1073741824" returned: 0 in 0.489s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:57 devstack sudo[114402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e Aug 26 16:29:57 devstack sudo[114402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:58 devstack sudo[114400]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507" returned: 0 in 0.698s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:58 devstack sudo[114402]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e" returned: 0 in 0.619s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:29:58 devstack sudo[114409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507 Aug 26 16:29:58 devstack sudo[114409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb95f43-3568-41f2-9f07-056695af17ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5411d379-ff67-4ecf-8f8d-418941e36eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:29:58 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Volume volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e (8d79f6f1-d22e-4ced-b572-18ab8d80ab3e): created successfully Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5411d379-ff67-4ecf-8f8d-418941e36eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Flow 'volume_create_manager' (725fec14-dfa4-461d-8c6a-61367a03a1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:29:58 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a462d448-8981-49cf-9cb8-5b4f888b8d38 tempest-ProjectReaderTests-1638074044 None] Created volume successfully. Aug 26 16:29:58 devstack sudo[114409]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf.4a6dabe3-0b1b-45b4-9cb5-e541d081b507" returned: 0 in 0.323s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Lock "cinder-quobyte-4a6dabe3-0b1b-45b4-9cb5-e541d081b507" released by "_delete_snapshot" :: held 2.134s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Lock "cinder-quobyte-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf" released by "delete_snapshot" :: held 2.192s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Created reservations ['8f7fde35-fb66-4a28-96a7-1e7599199753', '23c3477f-f0a1-4e76-bf6f-a12425f478f5', '78954b20-8553-4ee4-b1f8-7808815cb1dd', 'f73f1834-859b-46b6-863a-1d52bd6b9a5c'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:29:58 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Delete snapshot completed successfully. Aug 26 16:29:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3dba833b-1372-49d2-ac16-606575fcf124 tempest-CinderUnicodeTest-725567469 None] Lock "cinder-4a6dabe3-0b1b-45b4-9cb5-e541d081b507-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=234,cinder:UPDATE=321,cinder:INSERT=95,cinder:DELETE=27 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=237,cinder:UPDATE=324,cinder:DELETE=31,cinder:INSERT=77 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] Creating offline snapshot b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e of volume 8d79f6f1-d22e-4ced-b572-18ab8d80ab3e {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f350a4c-8725-4dc5-91e1-1964dcf44c68]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:59 devstack sudo[114412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e Aug 26 16:29:59 devstack sudo[114412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Acquiring lock "cinder-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Lock "cinder-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Acquiring lock "cinder-quobyte-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Lock "cinder-quobyte-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ca250f-27da-4685-aa1e-0a2d2581b48c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:59 devstack sudo[114412]: pam_unix(sudo:session): session closed for user root Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e" returned: 0 in 0.542s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:29:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:29:59 devstack sudo[114416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf Aug 26 16:29:59 devstack sudo[114416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:00 devstack sudo[114419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e 1G Aug 26 16:30:00 devstack sudo[114419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (365e0b87-7af6-4709-ad95-180523639453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be68e344-d333-401a-8fe7-0e189fc5548c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be68e344-d333-401a-8fe7-0e189fc5548c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-891583028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ee4514-a7cb-433f-aad5-3054c5125539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:00Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a34fa44-62ce-4ed8-af11-6c7270576ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:00 devstack sudo[114416]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a34fa44-62ce-4ed8-af11-6c7270576ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee14d319-f38c-4050-8be3-901052f0b399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee14d319-f38c-4050-8be3-901052f0b399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ee4514-a7cb-433f-aad5-3054c5125539', 'volume_name': 'volume-e2ee4514-a7cb-433f-aad5-3054c5125539', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3667d909-a020-4bc0-b842-e1a9d4173d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3667d909-a020-4bc0-b842-e1a9d4173d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2f59d7-1141-4630-9460-9ff7efd5c442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:00 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Volume e2ee4514-a7cb-433f-aad5-3054c5125539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ee4514-a7cb-433f-aad5-3054c5125539', 'volume_size': 1} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf" returned: 0 in 0.720s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:00 devstack sudo[114430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf Aug 26 16:30:00 devstack sudo[114430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:00 devstack sudo[114419]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e 1G" returned: 0 in 0.640s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:00 devstack sudo[114432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e Aug 26 16:30:00 devstack sudo[114432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:00 devstack sudo[114430]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf" returned: 0 in 0.403s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Lock "cinder-quobyte-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf" released by "delete_volume" :: held 1.216s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:00 devstack sudo[114432]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e" returned: 0 in 0.406s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:01 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e is being set with open permissions: ugo+rw Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:01 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e Aug 26 16:30:01 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Created reservations ['8a4ccf9b-1ae3-4fb4-8b06-b3814a2e7bbf', '3b97f43d-e913-4a03-a957-19df36ab1946', '23a6f530-ac71-4074-9bfd-00d6b07fa80e', '30364e0f-5cd9-48c8-9be0-0384a637d7dc'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:01 devstack sudo[114440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:01 devstack sudo[114440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:01 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e" returned: 0 in 0.265s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:01 devstack sudo[114443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.info Aug 26 16:30:01 devstack sudo[114443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:01 devstack sudo[114440]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.273s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Deleted volume successfully. Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3111f649-34c9-451c-9e0c-26c7ff7ffef9 tempest-CinderUnicodeTest-725567469 None] Lock "cinder-eebeaae7-dc2a-4ac6-abfd-d32c1f4b23cf-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:01 devstack sudo[114443]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.info" returned: 0 in 0.263s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:01 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.info is being set with open permissions: ugo+rw Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:01 devstack sudo[114447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.info Aug 26 16:30:01 devstack sudo[114447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:01 devstack sudo[114447]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.info" returned: 0 in 0.246s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.484s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-891583028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ee4514-a7cb-433f-aad5-3054c5125539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:00Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Creating volume e2ee4514-a7cb-433f-aad5-3054c5125539 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:30:01 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:01 devstack sudo[114450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539 1073741824 Aug 26 16:30:01 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-d2a13b6a-c200-465e-8a66-9facaf202bd1 tempest-ProjectReaderTests-1638074044 None] Create snapshot completed successfully Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Acquiring lock "cinder-ab641059-482c-48a3-ab87-c196f0c73760-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Lock "cinder-ab641059-482c-48a3-ab87-c196f0c73760-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Acquiring lock "cinder-quobyte-ab641059-482c-48a3-ab87-c196f0c73760" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Lock "cinder-quobyte-ab641059-482c-48a3-ab87-c196f0c73760" acquired by "delete_volume" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e427430-65a9-4248-b785-f473c4c314da]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab641059-482c-48a3-ab87-c196f0c73760 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:02 devstack sudo[114452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab641059-482c-48a3-ab87-c196f0c73760 Aug 26 16:30:02 devstack sudo[114452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:02 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539 1073741824" returned: 0 in 0.630s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:02 devstack sudo[114461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539 Aug 26 16:30:02 devstack sudo[114452]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:02 devstack sudo[114461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab641059-482c-48a3-ab87-c196f0c73760" returned: 0 in 0.519s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab641059-482c-48a3-ab87-c196f0c73760 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:02 devstack sudo[114463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab641059-482c-48a3-ab87-c196f0c73760 Aug 26 16:30:02 devstack sudo[114463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Deleting offline snapshot b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e of volume 8d79f6f1-d22e-4ced-b572-18ab8d80ab3e {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] snapshot_file for this snap is: volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[25328e15-b138-495a-8d56-a0d9c64bdea1]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:03 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e Aug 26 16:30:03 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:03 devstack sudo[114463]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-ab641059-482c-48a3-ab87-c196f0c73760" returned: 0 in 0.423s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Lock "cinder-quobyte-ab641059-482c-48a3-ab87-c196f0c73760" released by "delete_volume" :: held 1.011s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:03 devstack sudo[114461]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539" returned: 0 in 0.606s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2f59d7-1141-4630-9460-9ff7efd5c442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ee4514-a7cb-433f-aad5-3054c5125539', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e90a5c-b714-4c02-8224-5c7d4e7c871e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Created reservations ['f79819ca-41c0-4c33-a5a2-98ef5703b51f', '3a2763db-3271-43f2-92aa-8681a2e3da3c', '27ad5309-c6c4-41b6-bb2f-c53d71370c02', 'efa47206-7c95-4b26-9a81-baafbbda09b9'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:03 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Volume volume-e2ee4514-a7cb-433f-aad5-3054c5125539 (e2ee4514-a7cb-433f-aad5-3054c5125539): created successfully Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e90a5c-b714-4c02-8224-5c7d4e7c871e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (365e0b87-7af6-4709-ad95-180523639453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:03 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-01e0f370-e399-4930-8a9e-9752ab8d4c35 tempest-ProjectMemberTests-118857739 None] Created volume successfully. Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:03 devstack sudo[114471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:03 devstack sudo[114471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:03 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e" returned: 0 in 0.542s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16caaa8-a096-47d0-abd0-edd996ecacb8]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:03 devstack sudo[114474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e Aug 26 16:30:03 devstack sudo[114474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:03 devstack sudo[114471]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.278s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:03 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Deleted volume successfully. Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-df08136f-0021-4ffa-8387-2e87f37e128c tempest-CinderUnicodeTest-725567469 None] Lock "cinder-ab641059-482c-48a3-ab87-c196f0c73760-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:03 devstack sudo[114474]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e" returned: 0 in 0.480s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:03 devstack sudo[114480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e Aug 26 16:30:03 devstack sudo[114480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] Creating offline snapshot a7bf52a0-f6f8-485e-a568-ae3bc341396f of volume e2ee4514-a7cb-433f-aad5-3054c5125539 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:30:03 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[342250ed-cf8c-4c42-bee8-f2b1d4229638]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:04 devstack sudo[114482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539 Aug 26 16:30:04 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:04 devstack sudo[114480]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e" returned: 0 in 0.443s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:04 devstack sudo[114489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e Aug 26 16:30:04 devstack sudo[114489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:04 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539" returned: 0 in 0.463s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:04 devstack sudo[114492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f 1G Aug 26 16:30:04 devstack sudo[114492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:04 devstack sudo[114489]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e.b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e" returned: 0 in 0.309s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e" released by "_delete_snapshot" :: held 1.987s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e" released by "delete_snapshot" :: held 2.026s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:04 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Created reservations ['2ab83c77-dc87-479c-9245-9d373d1c3169', '6cdad913-5164-466e-94dc-9a41915c8b32', '1092bc77-4896-44ff-9e12-f156b7229b61', '0aa12374-c10a-4ae6-8518-cc4f80a8a0c9'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:04 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Delete snapshot completed successfully. Aug 26 16:30:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1f495e00-3d26-4425-8bd7-17e14ddb93e1 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-b59cd96e-1b9c-49ab-9f6b-a311fe1f1e1e-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:05 devstack sudo[114492]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f 1G" returned: 0 in 0.572s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ee4514-a7cb-433f-aad5-3054c5125539 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:05 devstack sudo[114500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ee4514-a7cb-433f-aad5-3054c5125539 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f Aug 26 16:30:05 devstack sudo[114500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:05 devstack sudo[114500]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ee4514-a7cb-433f-aad5-3054c5125539 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f" returned: 0 in 0.350s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:05 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f is being set with open permissions: ugo+rw Aug 26 16:30:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:05 devstack sudo[114505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f Aug 26 16:30:05 devstack sudo[114505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:05 devstack sudo[114505]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f" returned: 0 in 0.296s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:05 devstack sudo[114508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.info Aug 26 16:30:05 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Lock "cinder-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:05 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e" acquired by "delete_volume" :: waited 0.033s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:06 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.info" returned: 0 in 0.387s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:06 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.info is being set with open permissions: ugo+rw Aug 26 16:30:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:06 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bd5c5d-eb6a-4a41-92da-85c17ce8a9a3]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:06 devstack sudo[114514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.info Aug 26 16:30:06 devstack sudo[114514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:06 devstack sudo[114515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e Aug 26 16:30:06 devstack sudo[114515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:06 devstack sudo[114514]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.info" returned: 0 in 0.311s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.484s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5ef23580-c825-4928-9959-018257420db5 tempest-ProjectMemberTests-118857739 None] Create snapshot completed successfully Aug 26 16:30:06 devstack sudo[114515]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e" returned: 0 in 0.453s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:06 devstack sudo[114523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e Aug 26 16:30:06 devstack sudo[114523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:06 devstack sudo[114523]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e" returned: 0 in 0.272s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e" released by "delete_volume" :: held 0.845s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:06 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Created reservations ['c87f35dd-15f5-4acb-b08c-3137e93d0243', '9362f86a-6f56-4b77-8794-56fe71862920', '7ce4be83-bd5a-484f-9e6c-084566d10306', 'f0c4feba-42dc-470c-a202-bbb8004989a7'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:07 devstack sudo[114526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:07 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-a7bf52a0-f6f8-485e-a568-ae3bc341396f-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Lock "cinder-a7bf52a0-f6f8-485e-a568-ae3bc341396f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-e2ee4514-a7cb-433f-aad5-3054c5125539" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-e2ee4514-a7cb-433f-aad5-3054c5125539" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-a7bf52a0-f6f8-485e-a568-ae3bc341396f" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-a7bf52a0-f6f8-485e-a568-ae3bc341396f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Deleting offline snapshot a7bf52a0-f6f8-485e-a568-ae3bc341396f of volume e2ee4514-a7cb-433f-aad5-3054c5125539 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] snapshot_file for this snap is: volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cd170c-d136-4e90-a4ca-582a97513a44]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:07 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.424s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:07 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Deleted volume successfully. Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-8d02f2b4-88fd-49b2-adbb-4c470c6eb5ce tempest-ProjectReaderTests-1638074044 None] Lock "cinder-8d79f6f1-d22e-4ced-b572-18ab8d80ab3e-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:07 devstack sudo[114529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f Aug 26 16:30:07 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Flow 'volume_create_manager' (eacc94f3-2320-4d49-84a8-f23fe6f318ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b425f40-d262-4bf4-b027-d1519bc9c7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b425f40-d262-4bf4-b027-d1519bc9c7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237261673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fa13c1-2b8f-45ed-8028-08a4ae995d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094516a040fc46c9b0bf6405b1ade1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:08Z,use_quota=True,user_id='b8524ea575bc43c3942aadee8c091467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c960ebe-3adf-40ff-a49d-5a5c716115de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c960ebe-3adf-40ff-a49d-5a5c716115de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5112e1ec-bd5d-4005-b43c-a840b5879585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5112e1ec-bd5d-4005-b43c-a840b5879585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9fa13c1-2b8f-45ed-8028-08a4ae995d17', 'volume_name': 'volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20f8b21-ef55-44c8-ac58-a22c13285871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20f8b21-ef55-44c8-ac58-a22c13285871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbcd0b0e-70b4-4b80-83bc-bbc892da01d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:07 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Volume f9fa13c1-2b8f-45ed-8028-08a4ae995d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17', 'volume_size': 1} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237261673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fa13c1-2b8f-45ed-8028-08a4ae995d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094516a040fc46c9b0bf6405b1ade1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:08Z,use_quota=True,user_id='b8524ea575bc43c3942aadee8c091467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Creating volume f9fa13c1-2b8f-45ed-8028-08a4ae995d17 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:07 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:30:07 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f" returned: 0 in 0.500s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2ee4514-a7cb-433f-aad5-3054c5125539(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:30:07 devstack sudo[114535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 1073741824 Aug 26 16:30:07 devstack sudo[114535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[6697fdd8-570a-4af4-9d94-117156a49666]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:08 devstack sudo[114537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539 Aug 26 16:30:08 devstack sudo[114537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:08 devstack sudo[114537]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539" returned: 0 in 0.432s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:08 devstack sudo[114535]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 1073741824" returned: 0 in 0.494s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:08 devstack sudo[114546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f Aug 26 16:30:08 devstack sudo[114546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:08 devstack sudo[114548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 Aug 26 16:30:08 devstack sudo[114548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:08 devstack sudo[114548]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17" returned: 0 in 0.272s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:08 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:30:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbcd0b0e-70b4-4b80-83bc-bbc892da01d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cb3591-e50e-43c1-83f9-ea2fa223d80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:08 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Volume volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 (f9fa13c1-2b8f-45ed-8028-08a4ae995d17): created successfully Aug 26 16:30:08 devstack sudo[114546]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cb3591-e50e-43c1-83f9-ea2fa223d80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:08 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Flow 'volume_create_manager' (eacc94f3-2320-4d49-84a8-f23fe6f318ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f" returned: 0 in 0.393s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-6a7d3a03-a4c2-496e-8fda-50230bc5dd19 tempest-ProjectReaderTests-1638074044 None] Created volume successfully. Aug 26 16:30:08 devstack sudo[114555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f Aug 26 16:30:08 devstack sudo[114555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:09 devstack sudo[114555]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539.a7bf52a0-f6f8-485e-a568-ae3bc341396f" returned: 0 in 0.257s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-a7bf52a0-f6f8-485e-a568-ae3bc341396f" released by "_delete_snapshot" :: held 1.727s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-e2ee4514-a7cb-433f-aad5-3054c5125539" released by "delete_snapshot" :: held 1.762s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:09 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Created reservations ['f4429d6e-a2b6-4cb8-a103-c17732b8380f', 'cac048e0-095e-4789-b37d-40dcfb6b54cb', 'ea7593cb-b570-4083-aa2f-4bb772b632dd', '12260d35-ad6e-41e2-a3f6-715ad2f5f944'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:09 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Delete snapshot completed successfully. Aug 26 16:30:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-51a17f8f-cd58-4ba4-ae51-4acdcdf9ac84 tempest-ProjectMemberTests-118857739 None] Lock "cinder-a7bf52a0-f6f8-485e-a568-ae3bc341396f-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-e2ee4514-a7cb-433f-aad5-3054c5125539-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Lock "cinder-e2ee4514-a7cb-433f-aad5-3054c5125539-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-e2ee4514-a7cb-433f-aad5-3054c5125539" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-e2ee4514-a7cb-433f-aad5-3054c5125539" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:09 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0207e7-e52a-4368-8bc9-b00e4eef4b14]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:09 devstack sudo[114558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539 Aug 26 16:30:09 devstack sudo[114558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] Creating offline snapshot adee52df-6d73-44de-bd75-a8cb2ac9b787 of volume f9fa13c1-2b8f-45ed-8028-08a4ae995d17 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6e8bbf-4775-4cb5-8fb1-f19ff3702fc3]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:10 devstack sudo[114558]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539" returned: 0 in 0.540s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:10 devstack sudo[114565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539 Aug 26 16:30:10 devstack sudo[114565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:10 devstack sudo[114561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 Aug 26 16:30:10 devstack sudo[114561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:10 devstack sudo[114565]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e2ee4514-a7cb-433f-aad5-3054c5125539" returned: 0 in 0.247s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-e2ee4514-a7cb-433f-aad5-3054c5125539" released by "delete_volume" :: held 0.864s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:10 devstack sudo[114561]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17" returned: 0 in 0.409s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:10 devstack sudo[114573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 1G Aug 26 16:30:10 devstack sudo[114573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Created reservations ['68be485b-f3b6-4cd8-8ebc-54a24033208d', '3d9807d8-c7c9-493f-b8b7-7a9c3d2599cb', '9976a155-6e41-41db-9952-d0c3e8b8a745', 'eecf4ab8-eccf-4357-acbd-750d469b114d'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:10 devstack sudo[114575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:10 devstack sudo[114575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:10 devstack sudo[114575]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.307s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:10 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Deleted volume successfully. Aug 26 16:30:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-75b28622-46b6-4024-afcd-e6fd14adaf73 tempest-ProjectMemberTests-118857739 None] Lock "cinder-e2ee4514-a7cb-433f-aad5-3054c5125539-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:11 devstack sudo[114573]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 1G" returned: 0 in 0.643s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:11 devstack sudo[114582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 Aug 26 16:30:11 devstack sudo[114582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (c2dea950-51e1-4c47-9f00-5d53bea2f8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd93478f-6e4b-4b39-bf1f-4a3d645bb122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd93478f-6e4b-4b39-bf1f-4a3d645bb122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2110974262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:11Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd8a22c-2196-4361-a50a-502b491289f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd8a22c-2196-4361-a50a-502b491289f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf7dc9e-69d6-4a8b-9f57-7c164adab488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf7dc9e-69d6-4a8b-9f57-7c164adab488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2', 'volume_name': 'volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b8fc5d-5beb-4cb9-9acd-a9c087a0369f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b8fc5d-5beb-4cb9-9acd-a9c087a0369f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e54542-88cd-4c8d-b5c6-4b2550fd8449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:11 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Volume e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2', 'volume_size': 1} Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:11 devstack sudo[114582]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787" returned: 0 in 0.326s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:11 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 is being set with open permissions: ugo+rw Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:11 devstack sudo[114590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 Aug 26 16:30:11 devstack sudo[114590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:11 devstack sudo[114590]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787" returned: 0 in 0.246s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:11 devstack sudo[114594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.info Aug 26 16:30:11 devstack sudo[114594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:11 devstack sudo[114594]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.info" returned: 0 in 0.269s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:11 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.info is being set with open permissions: ugo+rw Aug 26 16:30:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:12 devstack sudo[114597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.info Aug 26 16:30:12 devstack sudo[114597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:12 devstack sudo[114597]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.info" returned: 0 in 0.277s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.977s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2110974262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:11Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Creating volume e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:30:12 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:12 devstack sudo[114600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 1073741824 Aug 26 16:30:12 devstack sudo[114600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:12 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ee91e677-8edb-4018-a424-261b5a812332 tempest-ProjectReaderTests-1638074044 None] Create snapshot completed successfully Aug 26 16:30:12 devstack sudo[114600]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 1073741824" returned: 0 in 0.469s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:12 devstack sudo[114606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 Aug 26 16:30:12 devstack sudo[114606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:13 devstack sudo[114606]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2" returned: 0 in 0.257s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e54542-88cd-4c8d-b5c6-4b2550fd8449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed10e62-e6ea-405b-811f-a1a0cf6ec537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:13 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Volume volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 (e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2): created successfully Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed10e62-e6ea-405b-811f-a1a0cf6ec537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (c2dea950-51e1-4c47-9f00-5d53bea2f8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9e759c34-1509-43a6-90ed-025e26285c6f tempest-ProjectMemberTests-118857739 None] Created volume successfully. Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-adee52df-6d73-44de-bd75-a8cb2ac9b787-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-adee52df-6d73-44de-bd75-a8cb2ac9b787-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-f9fa13c1-2b8f-45ed-8028-08a4ae995d17" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-f9fa13c1-2b8f-45ed-8028-08a4ae995d17" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-adee52df-6d73-44de-bd75-a8cb2ac9b787" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-adee52df-6d73-44de-bd75-a8cb2ac9b787" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Deleting offline snapshot adee52df-6d73-44de-bd75-a8cb2ac9b787 of volume f9fa13c1-2b8f-45ed-8028-08a4ae995d17 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] snapshot_file for this snap is: volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfde4632-f46e-490d-9b1e-c5f3a0c7783a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:13 devstack sudo[114609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 Aug 26 16:30:13 devstack sudo[114609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] Creating offline snapshot 62cc9024-4473-4845-8060-6b1340391fa8 of volume e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[832dadf3-2585-48e7-b275-189ac6be1e46]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:13 devstack sudo[114611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 Aug 26 16:30:13 devstack sudo[114611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:13 devstack sudo[114609]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787" returned: 0 in 0.401s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9501f9-3650-4892-9b8c-7a1a9d55a6bb]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:13 devstack sudo[114611]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2" returned: 0 in 0.373s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:13 devstack sudo[114616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 Aug 26 16:30:13 devstack sudo[114616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:13 devstack sudo[114621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 1G Aug 26 16:30:13 devstack sudo[114621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:14 devstack sudo[114616]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17" returned: 0 in 0.423s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:14 devstack sudo[114630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 Aug 26 16:30:14 devstack sudo[114630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:14 devstack sudo[114621]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 1G" returned: 0 in 0.499s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:14 devstack sudo[114633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 Aug 26 16:30:14 devstack sudo[114633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:14 devstack sudo[114630]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787" returned: 0 in 0.368s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:14 devstack sudo[114638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787 Aug 26 16:30:14 devstack sudo[114638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:14 devstack sudo[114633]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8" returned: 0 in 0.315s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:14 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 is being set with open permissions: ugo+rw Aug 26 16:30:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:14 devstack sudo[114645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 Aug 26 16:30:14 devstack sudo[114645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:14 devstack sudo[114638]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17.adee52df-6d73-44de-bd75-a8cb2ac9b787" returned: 0 in 0.291s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-adee52df-6d73-44de-bd75-a8cb2ac9b787" released by "_delete_snapshot" :: held 1.627s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:14 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-f9fa13c1-2b8f-45ed-8028-08a4ae995d17" released by "delete_snapshot" :: held 1.657s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:15 devstack sudo[114645]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8" returned: 0 in 0.273s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Created reservations ['a9f09430-5a93-4d69-9dd7-440469ab0a29', '23280c9a-9a8f-4c5f-8eac-3ef50dafc504', '9514084c-da45-47cb-ac0f-3290271619de', '97b3ee0b-7a1c-49a8-a6ce-ec21331fc692'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:15 devstack sudo[114649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.info Aug 26 16:30:15 devstack sudo[114649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:15 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Delete snapshot completed successfully. Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-f15ba524-d2e7-48e3-83a8-cc2af71c6172 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-adee52df-6d73-44de-bd75-a8cb2ac9b787-delete_snapshot" released by "delete_snapshot" :: held 1.866s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:15 devstack sudo[114649]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.info" returned: 0 in 0.304s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:15 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.info is being set with open permissions: ugo+rw Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:15 devstack sudo[114652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.info Aug 26 16:30:15 devstack sudo[114652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-f9fa13c1-2b8f-45ed-8028-08a4ae995d17-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-f9fa13c1-2b8f-45ed-8028-08a4ae995d17-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-f9fa13c1-2b8f-45ed-8028-08a4ae995d17" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-f9fa13c1-2b8f-45ed-8028-08a4ae995d17" acquired by "delete_volume" :: waited 0.034s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e3eefa-1f20-4045-aa2b-9f64bf1a478b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:15 devstack sudo[114652]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.info" returned: 0 in 0.319s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.185s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:15 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-f8bd74fa-fcae-46ed-8227-cd71acd47b8a tempest-ProjectMemberTests-118857739 None] Create snapshot completed successfully Aug 26 16:30:15 devstack sudo[114655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 Aug 26 16:30:15 devstack sudo[114655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:16 devstack sudo[114655]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17" returned: 0 in 0.437s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:16 devstack sudo[114661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17 Aug 26 16:30:16 devstack sudo[114661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:16 devstack sudo[114661]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f9fa13c1-2b8f-45ed-8028-08a4ae995d17" returned: 0 in 0.269s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-f9fa13c1-2b8f-45ed-8028-08a4ae995d17" released by "delete_volume" :: held 0.792s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Created reservations ['14e68111-af9a-46e9-9c46-68f68cbc7f64', 'd1d427db-510b-4230-9b28-b01926148c5b', 'daf20b1f-3e7b-4349-94c1-2863ea46a4fe', 'a77d038d-78c9-4aeb-9a3f-efc1c3336e48'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:16 devstack sudo[114664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:16 devstack sudo[114664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Flow 'volume_create_manager' (a8cdc3a5-a61e-4474-b16a-cfda79465ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a0b487-2018-4c1a-85b5-e270283fc2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-62cc9024-4473-4845-8060-6b1340391fa8-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a0b487-2018-4c1a-85b5-e270283fc2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1694373149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd686e6-c79f-41d6-a10f-6a7edcfa79ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acdbbc31ade4176a8e33add528d7e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:17Z,use_quota=True,user_id='f22de37925c143f194916073d0760736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6712a49e-7ca7-4e3b-bc44-2f6947659dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6712a49e-7ca7-4e3b-bc44-2f6947659dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16032d01-7046-4783-80cc-8c01a382d021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16032d01-7046-4783-80cc-8c01a382d021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd686e6-c79f-41d6-a10f-6a7edcfa79ff', 'volume_name': 'volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310b6e73-69b0-4bc5-8e77-5b55c88b56f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310b6e73-69b0-4bc5-8e77-5b55c88b56f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cb8f02-9b19-41cc-ada5-e1891280a555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:16 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Volume 0bd686e6-c79f-41d6-a10f-6a7edcfa79ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff', 'volume_size': 1} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1694373149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd686e6-c79f-41d6-a10f-6a7edcfa79ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acdbbc31ade4176a8e33add528d7e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:17Z,use_quota=True,user_id='f22de37925c143f194916073d0760736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Creating volume 0bd686e6-c79f-41d6-a10f-6a7edcfa79ff {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:30:16 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:16 devstack sudo[114664]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.284s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Lock "cinder-62cc9024-4473-4845-8060-6b1340391fa8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.107s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:16 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Deleted volume successfully. Aug 26 16:30:16 devstack sudo[114667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff 1073741824 Aug 26 16:30:16 devstack sudo[114667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-62cc9024-4473-4845-8060-6b1340391fa8" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-2943e152-34a9-4cd5-be4f-335b3b0e3936 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-f9fa13c1-2b8f-45ed-8028-08a4ae995d17-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-62cc9024-4473-4845-8060-6b1340391fa8" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Deleting offline snapshot 62cc9024-4473-4845-8060-6b1340391fa8 of volume e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] snapshot_file for this snap is: volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e3c781-260d-4b5d-be1f-089c7a0461ae]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:17 devstack sudo[114669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 Aug 26 16:30:17 devstack sudo[114669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Flow 'volume_create_manager' (18e770b1-fa49-48c3-bc86-72f697de04ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc66c4d-6bb3-4231-83bb-5b0f1d450154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:17 devstack sudo[114667]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff 1073741824" returned: 0 in 0.501s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc66c4d-6bb3-4231-83bb-5b0f1d450154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1280421856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142963ba-cc1a-41b9-b4ad-a34e6a3c7e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094516a040fc46c9b0bf6405b1ade1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:17Z,use_quota=True,user_id='b8524ea575bc43c3942aadee8c091467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0991091-b5d0-4dad-8ed1-18ee97b6c5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0991091-b5d0-4dad-8ed1-18ee97b6c5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81715a8-5815-44cb-bed4-eeb68d0507e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81715a8-5815-44cb-bed4-eeb68d0507e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '142963ba-cc1a-41b9-b4ad-a34e6a3c7e04', 'volume_name': 'volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62d928a-1d55-4a85-a7a6-bbc93204f13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:17 devstack sudo[114669]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62d928a-1d55-4a85-a7a6-bbc93204f13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa85694-f261-4837-a9aa-8536eb5b08e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:17 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Volume 142963ba-cc1a-41b9-b4ad-a34e6a3c7e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04', 'volume_size': 1} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8" returned: 0 in 0.431s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1d40f8-ae9e-45cb-8c9b-1ae8fa459927]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:17 devstack sudo[114679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff Aug 26 16:30:17 devstack sudo[114679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:17 devstack sudo[114678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 Aug 26 16:30:17 devstack sudo[114678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:17 devstack sudo[114679]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff" returned: 0 in 0.272s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.333s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1280421856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142963ba-cc1a-41b9-b4ad-a34e6a3c7e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094516a040fc46c9b0bf6405b1ade1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:17Z,use_quota=True,user_id='b8524ea575bc43c3942aadee8c091467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Creating volume 142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:30:17 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cb8f02-9b19-41cc-ada5-e1891280a555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfa45fe-9a5c-4613-9f0c-da7e55fab79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:17 devstack sudo[114685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 1073741824 Aug 26 16:30:17 devstack sudo[114685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:17 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Volume volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff (0bd686e6-c79f-41d6-a10f-6a7edcfa79ff): created successfully Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfa45fe-9a5c-4613-9f0c-da7e55fab79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Flow 'volume_create_manager' (a8cdc3a5-a61e-4474-b16a-cfda79465ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:17 devstack sudo[114678]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:17 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c06b64cf-2369-4a83-b6b6-c00dff9f7fb0 tempest-SnapshotDependencyTests-1904867874 None] Created volume successfully. Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2" returned: 0 in 0.383s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:17 devstack sudo[114688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 Aug 26 16:30:17 devstack sudo[114688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:18 devstack sudo[114695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:18 devstack sudo[114695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:18 devstack sudo[114688]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8" returned: 0 in 0.353s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:18 devstack sudo[114685]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 1073741824" returned: 0 in 0.458s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:18 devstack sudo[114700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8 Aug 26 16:30:18 devstack sudo[114700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:18 devstack sudo[114702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 Aug 26 16:30:18 devstack sudo[114702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:18 devstack sudo[114695]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.300s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 29 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:30:18 devstack sudo[114700]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2.62cc9024-4473-4845-8060-6b1340391fa8" returned: 0 in 0.246s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-62cc9024-4473-4845-8060-6b1340391fa8" released by "_delete_snapshot" :: held 1.530s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2" released by "delete_snapshot" :: held 1.569s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:18 devstack sudo[114702]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04" returned: 0 in 0.257s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa85694-f261-4837-a9aa-8536eb5b08e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f692fa1-b547-423c-b9e7-dd3d812ffe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:18 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Volume volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 (142963ba-cc1a-41b9-b4ad-a34e6a3c7e04): created successfully Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f692fa1-b547-423c-b9e7-dd3d812ffe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Flow 'volume_create_manager' (18e770b1-fa49-48c3-bc86-72f697de04ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:18 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0fd5094c-257f-4c63-b087-99d85b704196 tempest-ProjectReaderTests-1638074044 None] Created volume successfully. Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Created reservations ['7278d48e-975d-4dd4-a215-dc9a2907cd7c', '92482e5c-e513-43f6-b9ff-e4bcbe88147d', 'd1f368bf-2551-4ecf-9131-ef0552cfeca7', 'fe04140d-3f5f-49bc-ab48-d3f1e65d840e'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:18 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Delete snapshot completed successfully. Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-d9322661-7a2c-493c-b3a7-4719da9fad51 tempest-ProjectMemberTests-118857739 None] Lock "cinder-62cc9024-4473-4845-8060-6b1340391fa8-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Lock "cinder-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] Creating offline snapshot cc88efd0-6eb4-4ed7-8944-2400588d6c6f of volume 0bd686e6-c79f-41d6-a10f-6a7edcfa79ff {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2dc056-7e22-4118-9743-e5996c33f5d2]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2" acquired by "delete_volume" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[75568054-d520-4589-ade7-a2526e45d7f0]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:19 devstack sudo[114707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff Aug 26 16:30:19 devstack sudo[114707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:19 devstack sudo[114708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 Aug 26 16:30:19 devstack sudo[114708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:19 devstack sudo[114707]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff" returned: 0 in 0.407s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:19 devstack sudo[114716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f 1G Aug 26 16:30:19 devstack sudo[114716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:19 devstack sudo[114708]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2" returned: 0 in 0.423s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:19 devstack sudo[114719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2 Aug 26 16:30:19 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:19 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2" returned: 0 in 0.282s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2" released by "delete_volume" :: held 0.773s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:19 devstack sudo[114716]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Created reservations ['3b5a14d0-00b4-48d4-aaac-dd22ae26106d', '2932e118-10fa-4d72-8ad8-7b37147c63aa', 'ca24d368-b094-495e-a5b9-944967a41c28', 'b86e8d0e-c634-41d2-a6fb-fcbe3865b872'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f 1G" returned: 0 in 0.467s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:19 devstack sudo[114726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f Aug 26 16:30:19 devstack sudo[114726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:19 devstack sudo[114728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:19 devstack sudo[114728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:20 devstack sudo[114726]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f" returned: 0 in 0.333s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:20 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f is being set with open permissions: ugo+rw Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:20 devstack sudo[114728]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.265s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:20 devstack sudo[114735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f Aug 26 16:30:20 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Deleted volume successfully. Aug 26 16:30:20 devstack sudo[114735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1142ba3f-f548-4bac-a7ed-8be1e6ae67f4 tempest-ProjectMemberTests-118857739 None] Lock "cinder-e4a4f82a-f0ce-42c5-9b2c-5dbbf28382b2-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:20 devstack sudo[114735]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f" returned: 0 in 0.297s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:20 devstack sudo[114738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.info Aug 26 16:30:20 devstack sudo[114738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (46f8e1bf-258c-4f4c-ab97-b7fe7cc4f331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50705330-f560-43f1-9b7b-e94c71137422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50705330-f560-43f1-9b7b-e94c71137422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164648767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd05802-72b7-4e81-9538-b8ce5529804b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:21Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157bd79e-bc1d-4584-a29c-6d9f4eec988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157bd79e-bc1d-4584-a29c-6d9f4eec988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c0c8fd-853b-4cd5-b340-af116b9ff3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c0c8fd-853b-4cd5-b340-af116b9ff3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd05802-72b7-4e81-9538-b8ce5529804b', 'volume_name': 'volume-9fd05802-72b7-4e81-9538-b8ce5529804b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d076609-c6b1-4f03-8163-c799b07bebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d076609-c6b1-4f03-8163-c799b07bebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec18533-3c3e-42f2-ba48-79e72669efdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:20 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Volume 9fd05802-72b7-4e81-9538-b8ce5529804b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd05802-72b7-4e81-9538-b8ce5529804b', 'volume_size': 1} Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:20 devstack sudo[114738]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.info" returned: 0 in 0.256s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:20 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.info is being set with open permissions: ugo+rw Aug 26 16:30:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:20 devstack sudo[114741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.info Aug 26 16:30:20 devstack sudo[114741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:21 devstack sudo[114741]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.info" returned: 0 in 0.247s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.563s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] Creating offline snapshot 4b709f53-2356-45ef-8d70-79f7e8df74d2 of volume 142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:30:21 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-124ddefb-3dd5-4f04-8af7-2d087a146c60 tempest-SnapshotDependencyTests-1904867874 None] Create snapshot completed successfully Aug 26 16:30:21 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[64446142-311a-4cad-9a3c-bd1e55f80bc1]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:21 devstack sudo[114744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 Aug 26 16:30:21 devstack sudo[114744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:21 devstack sudo[114744]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04" returned: 0 in 0.359s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:21 devstack sudo[114750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 1G Aug 26 16:30:21 devstack sudo[114750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:21 devstack sudo[114750]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 1G" returned: 0 in 0.397s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:21 devstack sudo[114755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 Aug 26 16:30:21 devstack sudo[114755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:22 devstack sudo[114755]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2" returned: 0 in 0.302s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:22 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 is being set with open permissions: ugo+rw Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:22 devstack sudo[114761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 Aug 26 16:30:22 devstack sudo[114761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:22 devstack sudo[114761]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2" returned: 0 in 0.247s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:22 devstack sudo[114764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.info Aug 26 16:30:22 devstack sudo[114764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:30:22 devstack sudo[114764]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Flow 'volume_create_manager' (49d2043a-43dd-49a4-82f7-e89145958757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86694b91-c849-4223-bb8c-820a2eca2582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.info" returned: 0 in 0.289s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:22 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.info is being set with open permissions: ugo+rw Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86694b91-c849-4223-bb8c-820a2eca2582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36213f71-7433-4faf-b37c-0c623e2b787f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acdbbc31ade4176a8e33add528d7e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc88efd0-6eb4-4ed7-8944-2400588d6c6f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:23Z,use_quota=True,user_id='f22de37925c143f194916073d0760736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:22 devstack sudo[114767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.info Aug 26 16:30:22 devstack sudo[114767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3309e1-5d0f-484f-bae0-ed5c9e9f160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3309e1-5d0f-484f-bae0-ed5c9e9f160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88190914-b389-47db-a579-4f5af0ed3a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88190914-b389-47db-a579-4f5af0ed3a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '36213f71-7433-4faf-b37c-0c623e2b787f', 'volume_name': 'volume-36213f71-7433-4faf-b37c-0c623e2b787f', 'volume_size': 1, 'snapshot_id': 'cc88efd0-6eb4-4ed7-8944-2400588d6c6f'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf924c5-8bc8-447f-9a57-80f55e6dccc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf924c5-8bc8-447f-9a57-80f55e6dccc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9573ea9-391c-43ca-805c-3c4df9c535e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:22 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Volume 36213f71-7433-4faf-b37c-0c623e2b787f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-36213f71-7433-4faf-b37c-0c623e2b787f', 'volume_size': 1, 'snapshot_id': 'cc88efd0-6eb4-4ed7-8944-2400588d6c6f'} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:22 devstack sudo[114767]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.info" returned: 0 in 0.251s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.287s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164648767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd05802-72b7-4e81-9538-b8ce5529804b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:21Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Creating volume 9fd05802-72b7-4e81-9538-b8ce5529804b {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:22 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:30:23 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:23 devstack sudo[114770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b 1073741824 Aug 26 16:30:23 devstack sudo[114770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:23 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b04c5a48-addc-4695-9355-06c33ec44788 tempest-ProjectReaderTests-1638074044 None] Create snapshot completed successfully Aug 26 16:30:23 devstack sudo[114770]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b 1073741824" returned: 0 in 0.410s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:23 devstack sudo[114776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b Aug 26 16:30:23 devstack sudo[114776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:23 devstack sudo[114776]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b" returned: 0 in 0.256s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.903s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "cinder-quobyte-cc88efd0-6eb4-4ed7-8944-2400588d6c6f-36213f71-7433-4faf-b37c-0c623e2b787f" by "_create_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-quobyte-cc88efd0-6eb4-4ed7-8944-2400588d6c6f-36213f71-7433-4faf-b37c-0c623e2b787f" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Creating volume 36213f71-7433-4faf-b37c-0c623e2b787f from snapshot cc88efd0-6eb4-4ed7-8944-2400588d6c6f {{(pid=94407) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "cinder-quobyte-36213f71-7433-4faf-b37c-0c623e2b787f" by "_copy_volume_from_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-4b709f53-2356-45ef-8d70-79f7e8df74d2-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec18533-3c3e-42f2-ba48-79e72669efdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd05802-72b7-4e81-9538-b8ce5529804b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cee5d8b-0f53-4d20-8040-d7d14451cf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-quobyte-36213f71-7433-4faf-b37c-0c623e2b787f" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] snapshot: cc88efd0-6eb4-4ed7-8944-2400588d6c6f, volume: 36213f71-7433-4faf-b37c-0c623e2b787f, {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-4b709f53-2356-45ef-8d70-79f7e8df74d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:23 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Volume volume-9fd05802-72b7-4e81-9538-b8ce5529804b (9fd05802-72b7-4e81-9538-b8ce5529804b): created successfully Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cee5d8b-0f53-4d20-8040-d7d14451cf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (46f8e1bf-258c-4f4c-ab97-b7fe7cc4f331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04" acquired by "delete_snapshot" :: waited 0.055s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-4b709f53-2356-45ef-8d70-79f7e8df74d2" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[556889cc-3082-4081-aa8b-17884874c8e6]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:23 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-aa271368-2c5f-4e73-bf31-f1adba7efb4e tempest-ProjectMemberTests-118857739 None] Created volume successfully. Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-4b709f53-2356-45ef-8d70-79f7e8df74d2" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Deleting offline snapshot 4b709f53-2356-45ef-8d70-79f7e8df74d2 of volume 142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] snapshot_file for this snap is: volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0fbf3d-7f14-4fd3-8e85-569da3b95284]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:23 devstack sudo[114779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f Aug 26 16:30:23 devstack sudo[114779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:24 devstack sudo[114780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 Aug 26 16:30:24 devstack sudo[114780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:24 devstack sudo[114779]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f" returned: 0 in 0.377s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2e06f3-a95d-4389-8a4b-b095bb8d23af]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:24 devstack sudo[114780]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2" returned: 0 in 0.353s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c4385d-929c-4b58-85de-aa40c409f0de]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:24 devstack sudo[114789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff Aug 26 16:30:24 devstack sudo[114789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:24 devstack sudo[114790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 Aug 26 16:30:24 devstack sudo[114790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:24 devstack sudo[114789]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff" returned: 0 in 0.357s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] will copy from snapshot at /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Creating direct copy from snapshot {{(pid=94407) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG cinder.utils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Path /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f not found in is_blk_device check {{(pid=94407) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:24 devstack sudo[114799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f Aug 26 16:30:24 devstack sudo[114799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:24 devstack sudo[114790]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04" returned: 0 in 0.355s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:24 devstack sudo[114801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 Aug 26 16:30:24 devstack sudo[114801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:25 devstack sudo[114801]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2" returned: 0 in 0.397s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:25 devstack sudo[114811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2 Aug 26 16:30:25 devstack sudo[114811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:25 devstack sudo[114811]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:25 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04.4b709f53-2356-45ef-8d70-79f7e8df74d2" returned: 0 in 0.426s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-4b709f53-2356-45ef-8d70-79f7e8df74d2" released by "_delete_snapshot" :: held 1.650s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04" released by "delete_snapshot" :: held 1.697s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:25 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Created reservations ['b4c48726-cab3-487d-9fc9-6cf26026c818', 'a7ad08c6-ae89-462b-997b-ef217b79fece', '73195535-b37d-40ca-a306-007659e03553', 'bb4a2974-a973-4e6e-85e1-8bf329c64db7'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:25 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Delete snapshot completed successfully. Aug 26 16:30:25 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b59a47c3-3110-4a41-80b1-5f721f0b8ce5 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-4b709f53-2356-45ef-8d70-79f7e8df74d2-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "cinder-quobyte-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:27 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04" acquired by "delete_volume" :: waited 0.032s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:27 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c2ec00-132a-40e1-958e-130f93e07826]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:27 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:27 devstack sudo[114821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 Aug 26 16:30:27 devstack sudo[114821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:28 devstack sudo[114821]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04" returned: 0 in 0.777s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:28 devstack sudo[114826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04 Aug 26 16:30:28 devstack sudo[114826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:28 devstack sudo[114826]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04" returned: 0 in 0.464s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:28 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-quobyte-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04" released by "delete_volume" :: held 1.393s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:28 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Created reservations ['0e0d970f-e847-4628-9ba3-127b893ed953', 'b487ae55-793c-4e1e-b399-041df7acd252', 'b04e8df1-aaf4-4963-9ba7-260b1c82ec97', 'e6edc761-edd9-47e4-af85-40befc40cc23'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:28 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:28 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:29 devstack sudo[114829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:29 devstack sudo[114829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:29 devstack sudo[114799]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f" returned: 0 in 4.577s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG cinder.image.image_utils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Image conversion details: src /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff, size 1024.00 MB, duration 4.58 sec, destination /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f {{(pid=94407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 16:30:29 devstack cinder-volume[94407]: INFO cinder.image.image_utils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Converted 1024.00 MB image at 223.68 MB/s Aug 26 16:30:29 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f is being set with open permissions: ugo+rw Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:29 devstack sudo[114831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f Aug 26 16:30:29 devstack sudo[114831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:29 devstack sudo[114829]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.343s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:29 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Deleted volume successfully. Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c5a5c8e2-cad6-423c-8e4f-46d2ea0fdc36 tempest-ProjectReaderTests-1638074044 None] Lock "cinder-142963ba-cc1a-41b9-b4ad-a34e6a3c7e04-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:29 devstack sudo[114831]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f" returned: 0 in 0.252s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-quobyte-36213f71-7433-4faf-b37c-0c623e2b787f" released by "_copy_volume_from_snapshot" :: held 5.672s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-quobyte-cc88efd0-6eb4-4ed7-8944-2400588d6c6f-36213f71-7433-4faf-b37c-0c623e2b787f" released by "_create_volume_from_snapshot" :: held 5.766s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.790s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.499s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] Creating offline snapshot 7e4c5c4a-8988-44c6-a0e6-36226530389e of volume 9fd05802-72b7-4e81-9538-b8ce5529804b {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9573ea9-391c-43ca-805c-3c4df9c535e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36213f71-7433-4faf-b37c-0c623e2b787f', 'volume_size': 1, 'snapshot_id': 'cc88efd0-6eb4-4ed7-8944-2400588d6c6f'}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9380fc30-87be-41c2-954e-61b126745c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c286a749-83b8-4193-aab1-3bbbcd3fe350]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:29 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Volume volume-36213f71-7433-4faf-b37c-0c623e2b787f (36213f71-7433-4faf-b37c-0c623e2b787f): created successfully Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9380fc30-87be-41c2-954e-61b126745c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Flow 'volume_create_manager' (49d2043a-43dd-49a4-82f7-e89145958757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:29 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-18f57662-49b3-416c-833d-a9ce375f30da tempest-SnapshotDependencyTests-1904867874 None] Created volume successfully. Aug 26 16:30:29 devstack sudo[114835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b Aug 26 16:30:29 devstack sudo[114835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:29 devstack sudo[114835]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b" returned: 0 in 0.380s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:29 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:29 devstack sudo[114841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e 1G Aug 26 16:30:29 devstack sudo[114841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:30 devstack sudo[114841]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e 1G" returned: 0 in 0.509s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd05802-72b7-4e81-9538-b8ce5529804b -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:30 devstack sudo[114847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd05802-72b7-4e81-9538-b8ce5529804b -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e Aug 26 16:30:30 devstack sudo[114847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "cinder-cc88efd0-6eb4-4ed7-8944-2400588d6c6f-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-cc88efd0-6eb4-4ed7-8944-2400588d6c6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "cinder-quobyte-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-quobyte-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "cinder-quobyte-cc88efd0-6eb4-4ed7-8944-2400588d6c6f" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-quobyte-cc88efd0-6eb4-4ed7-8944-2400588d6c6f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Deleting offline snapshot cc88efd0-6eb4-4ed7-8944-2400588d6c6f of volume 0bd686e6-c79f-41d6-a10f-6a7edcfa79ff {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] snapshot_file for this snap is: volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[46964946-8fea-4bbe-9079-8157e1e77e88]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:30 devstack sudo[114849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f Aug 26 16:30:30 devstack sudo[114849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:30 devstack sudo[114847]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd05802-72b7-4e81-9538-b8ce5529804b -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e" returned: 0 in 0.393s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:30 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e is being set with open permissions: ugo+rw Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:30 devstack sudo[114855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e Aug 26 16:30:30 devstack sudo[114855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:30 devstack sudo[114849]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f" returned: 0 in 0.419s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:30 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:30:31 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee168bd9-9003-4fe7-b27d-8d42eac95890]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:31 devstack sudo[114855]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e" returned: 0 in 0.266s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:31 devstack sudo[114862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.info Aug 26 16:30:31 devstack sudo[114862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:31 devstack sudo[114861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff Aug 26 16:30:31 devstack sudo[114861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:31 devstack sudo[114862]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.info" returned: 0 in 0.325s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:31 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.info is being set with open permissions: ugo+rw Aug 26 16:30:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:31 devstack sudo[114902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.info Aug 26 16:30:31 devstack sudo[114902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:31 devstack sudo[114902]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.info" returned: 0 in 0.279s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:31 devstack sudo[114861]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff" returned: 0 in 0.720s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:31 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:31 devstack sudo[114908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f Aug 26 16:30:31 devstack sudo[114908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:31 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a7c5debe-0b72-4e68-8d26-3aee2ed77d0d tempest-ProjectMemberTests-118857739 None] Create snapshot completed successfully Aug 26 16:30:32 devstack sudo[114908]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f" returned: 0 in 0.367s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:32 devstack sudo[114913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f Aug 26 16:30:32 devstack sudo[114913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:32 devstack sudo[114913]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff.cc88efd0-6eb4-4ed7-8944-2400588d6c6f" returned: 0 in 0.255s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-quobyte-cc88efd0-6eb4-4ed7-8944-2400588d6c6f" released by "_delete_snapshot" :: held 1.902s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-quobyte-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff" released by "delete_snapshot" :: held 1.930s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-7e4c5c4a-8988-44c6-a0e6-36226530389e-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Lock "cinder-7e4c5c4a-8988-44c6-a0e6-36226530389e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-9fd05802-72b7-4e81-9538-b8ce5529804b" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-9fd05802-72b7-4e81-9538-b8ce5529804b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-7e4c5c4a-8988-44c6-a0e6-36226530389e" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-7e4c5c4a-8988-44c6-a0e6-36226530389e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Deleting offline snapshot 7e4c5c4a-8988-44c6-a0e6-36226530389e of volume 9fd05802-72b7-4e81-9538-b8ce5529804b {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] snapshot_file for this snap is: volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Created reservations ['95a144b4-d028-44b7-88c7-4ad2c0854289', 'ef48c33c-98f9-4a73-879b-5d9f996cbf13', 'b22edcaa-534b-4f2b-956d-75d36bec52c3', 'ed2ede64-718f-4e31-b644-ccfca0633a15'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a44a1fc-da27-4079-adce-34496f0a197c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:32 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Delete snapshot completed successfully. Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ca6198c7-3353-413a-a213-444be452e9c6 tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-cc88efd0-6eb4-4ed7-8944-2400588d6c6f-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:32 devstack sudo[114916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e Aug 26 16:30:32 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:32 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e" returned: 0 in 0.366s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fd05802-72b7-4e81-9538-b8ce5529804b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e870364d-51a6-44ba-a877-c32b6430b75a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:32 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:33 devstack sudo[114921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b Aug 26 16:30:33 devstack sudo[114921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:33 devstack sudo[114921]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b" returned: 0 in 0.374s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:33 devstack sudo[114926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e Aug 26 16:30:33 devstack sudo[114926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:33 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "cinder-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:33 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:33 devstack sudo[114926]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e" returned: 0 in 0.374s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:33 devstack sudo[114931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e Aug 26 16:30:33 devstack sudo[114931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:33 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "cinder-quobyte-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:33 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-quobyte-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff" acquired by "delete_volume" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:33 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8a400c-a3a1-4b42-a5bd-2f225f2a87a3]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:33 devstack sudo[114933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff Aug 26 16:30:33 devstack sudo[114933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:33 devstack sudo[114931]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:33 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b.7e4c5c4a-8988-44c6-a0e6-36226530389e" returned: 0 in 0.248s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-7e4c5c4a-8988-44c6-a0e6-36226530389e" released by "_delete_snapshot" :: held 1.469s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-9fd05802-72b7-4e81-9538-b8ce5529804b" released by "delete_snapshot" :: held 1.510s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Created reservations ['f09044ed-ed0e-4e08-bb7d-973d1cbc7167', '6928874a-bcdf-48a1-9e6b-47cd7179f6a5', '508a89b9-6e07-4bd0-ae4c-ccbd6c0b8e2c', '4e8e808c-ab37-4e4b-81ed-820ae83adacd'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:34 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Delete snapshot completed successfully. Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-89b22c25-dd47-41be-9ae1-52063dc77adb tempest-ProjectMemberTests-118857739 None] Lock "cinder-7e4c5c4a-8988-44c6-a0e6-36226530389e-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:34 devstack sudo[114933]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff" returned: 0 in 0.375s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:34 devstack sudo[114939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff Aug 26 16:30:34 devstack sudo[114939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:34 devstack sudo[114939]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff" returned: 0 in 0.244s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-quobyte-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff" released by "delete_volume" :: held 0.677s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Created reservations ['27534553-cd27-4b94-a98f-687f88d5a1ab', 'a355fa11-caec-442e-9c6f-2b27a3778b9b', '538e7274-b3b2-46cc-9aeb-3929fd948def', '8dafcfbb-6f6a-4642-9552-c264a355e32a'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:34 devstack sudo[114942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:34 devstack sudo[114942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-9fd05802-72b7-4e81-9538-b8ce5529804b-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Lock "cinder-9fd05802-72b7-4e81-9538-b8ce5529804b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-9fd05802-72b7-4e81-9538-b8ce5529804b" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-9fd05802-72b7-4e81-9538-b8ce5529804b" acquired by "delete_volume" :: waited 0.026s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[a591eff0-fe00-48cb-9d0f-b2d567e0312e]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "cinder-36213f71-7433-4faf-b37c-0c623e2b787f-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:34 devstack sudo[114942]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-36213f71-7433-4faf-b37c-0c623e2b787f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.333s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:34 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:34 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Deleted volume successfully. Aug 26 16:30:34 devstack sudo[114945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b Aug 26 16:30:34 devstack sudo[114945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-eab9b4d5-4e96-4bfe-9322-3b485056910d tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-0bd686e6-c79f-41d6-a10f-6a7edcfa79ff-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "cinder-quobyte-36213f71-7433-4faf-b37c-0c623e2b787f" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-quobyte-36213f71-7433-4faf-b37c-0c623e2b787f" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[270c3fbf-e063-4fd9-b7b1-702ddc61c5cd]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:35 devstack sudo[114948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f Aug 26 16:30:35 devstack sudo[114948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:35 devstack sudo[114945]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b" returned: 0 in 0.430s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:35 devstack sudo[114953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b Aug 26 16:30:35 devstack sudo[114953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:35 devstack sudo[114948]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f" returned: 0 in 0.394s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:35 devstack sudo[114959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f Aug 26 16:30:35 devstack sudo[114959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:35 devstack sudo[114953]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9fd05802-72b7-4e81-9538-b8ce5529804b" returned: 0 in 0.291s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-9fd05802-72b7-4e81-9538-b8ce5529804b" released by "delete_volume" :: held 0.814s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Created reservations ['130295c6-63a3-4023-9cd5-f208aa3a4c59', '4ad04c61-043c-4af7-9715-4d72f1e42dd4', '2b4ce971-a77c-4357-9cfc-397d37419851', '709ac2f5-e8cd-4f7b-8d86-8ae115aeaf6a'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:35 devstack sudo[114959]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-36213f71-7433-4faf-b37c-0c623e2b787f" returned: 0 in 0.294s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:35 devstack sudo[114963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:35 devstack sudo[114963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-quobyte-36213f71-7433-4faf-b37c-0c623e2b787f" released by "delete_volume" :: held 0.742s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Created reservations ['a23f7d27-b5cd-477f-89bd-6a73d7cdaaaa', '0311c085-a0d1-49fb-b691-efa992f2f5b9', 'a8f64a63-d6f8-471a-999c-2dce7acb1a2a', 'a42f2217-d8f5-4fe2-ab9a-410f326f85c6'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:35 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:35 devstack sudo[114965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:35 devstack sudo[114965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:36 devstack sudo[114963]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.274s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:36 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Deleted volume successfully. Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-1cc94efb-34ba-4ac9-a956-aab674e1c687 tempest-ProjectMemberTests-118857739 None] Lock "cinder-9fd05802-72b7-4e81-9538-b8ce5529804b-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:36 devstack sudo[114965]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.299s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:36 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Deleted volume successfully. Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-fe351091-b682-4df6-8871-fda2634ad48c tempest-SnapshotDependencyTests-1904867874 None] Lock "cinder-36213f71-7433-4faf-b37c-0c623e2b787f-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (85c93b98-3b72-4e77-96f0-16bfc751855b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85b4cc4-41fb-4e13-b3ed-9bff78ceceb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85b4cc4-41fb-4e13-b3ed-9bff78ceceb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-830515504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79a4d7c-d9c1-4368-baca-66a61cca9882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:36Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4329d704-aa92-460e-a11d-5995cbaa739e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4329d704-aa92-460e-a11d-5995cbaa739e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49c14d8-bb2f-4311-8817-e45d0a2b9794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49c14d8-bb2f-4311-8817-e45d0a2b9794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79a4d7c-d9c1-4368-baca-66a61cca9882', 'volume_name': 'volume-f79a4d7c-d9c1-4368-baca-66a61cca9882', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43d84f9-8227-453f-9ca5-1ab8949ee5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43d84f9-8227-453f-9ca5-1ab8949ee5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7242b76-b064-4e17-93e0-89e17de565ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:36 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Volume f79a4d7c-d9c1-4368-baca-66a61cca9882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79a4d7c-d9c1-4368-baca-66a61cca9882', 'volume_size': 1} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-830515504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79a4d7c-d9c1-4368-baca-66a61cca9882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:36Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Creating volume f79a4d7c-d9c1-4368-baca-66a61cca9882 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:30:36 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:30:36 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:36 devstack sudo[114975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 1073741824 Aug 26 16:30:36 devstack sudo[114975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:37 devstack sudo[114975]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 1073741824" returned: 0 in 0.538s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:37 devstack sudo[114981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 Aug 26 16:30:37 devstack sudo[114981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:37 devstack sudo[114981]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882" returned: 0 in 0.277s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:37 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:30:37 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7242b76-b064-4e17-93e0-89e17de565ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79a4d7c-d9c1-4368-baca-66a61cca9882', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6322dd12-c233-4246-8fe2-de161c1a002c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:37 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Volume volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 (f79a4d7c-d9c1-4368-baca-66a61cca9882): created successfully Aug 26 16:30:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6322dd12-c233-4246-8fe2-de161c1a002c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:37 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (85c93b98-3b72-4e77-96f0-16bfc751855b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:37 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-a489d105-2598-423f-be93-fb68f18cdd65 tempest-ProjectMemberTests-118857739 None] Created volume successfully. Aug 26 16:30:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:38 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] Creating offline snapshot 470cd0fb-14f5-452c-af45-b69a616be13b of volume f79a4d7c-d9c1-4368-baca-66a61cca9882 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:30:38 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[df593e4b-a16c-472a-a9b3-251a837cdfe7]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:38 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:38 devstack sudo[114985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 Aug 26 16:30:38 devstack sudo[114985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:39 devstack sudo[114985]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882" returned: 0 in 0.409s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:39 devstack sudo[114990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b 1G Aug 26 16:30:39 devstack sudo[114990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:39 devstack sudo[114990]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b 1G" returned: 0 in 0.442s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:39 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:39 devstack sudo[114995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b Aug 26 16:30:39 devstack sudo[114995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:40 devstack sudo[114995]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b" returned: 0 in 0.375s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:40 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b is being set with open permissions: ugo+rw Aug 26 16:30:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:40 devstack sudo[115001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b Aug 26 16:30:40 devstack sudo[115001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:40 devstack sudo[115001]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b" returned: 0 in 0.304s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:40 devstack sudo[115004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.info Aug 26 16:30:40 devstack sudo[115004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:40 devstack sudo[115004]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.info" returned: 0 in 0.299s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:40 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.info is being set with open permissions: ugo+rw Aug 26 16:30:40 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:40 devstack sudo[115008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.info Aug 26 16:30:40 devstack sudo[115008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:41 devstack sudo[115008]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.info" returned: 0 in 0.317s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:41 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:41 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-5835f8a7-4e06-4f36-b6ec-0c113963a270 tempest-ProjectMemberTests-118857739 None] Create snapshot completed successfully Aug 26 16:30:41 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-470cd0fb-14f5-452c-af45-b69a616be13b-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Lock "cinder-470cd0fb-14f5-452c-af45-b69a616be13b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-f79a4d7c-d9c1-4368-baca-66a61cca9882" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-f79a4d7c-d9c1-4368-baca-66a61cca9882" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-470cd0fb-14f5-452c-af45-b69a616be13b" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-470cd0fb-14f5-452c-af45-b69a616be13b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Deleting offline snapshot 470cd0fb-14f5-452c-af45-b69a616be13b of volume f79a4d7c-d9c1-4368-baca-66a61cca9882 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] snapshot_file for this snap is: volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f28f2db-d40e-4784-929d-b95144bba48a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:42 devstack sudo[115012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b Aug 26 16:30:42 devstack sudo[115012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:42 devstack sudo[115012]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b" returned: 0 in 0.431s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f79a4d7c-d9c1-4368-baca-66a61cca9882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc64cebf-60e5-457c-ad43-1a90c6234e9d]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:42 devstack sudo[115018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 Aug 26 16:30:42 devstack sudo[115018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:42 devstack sudo[115018]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882" returned: 0 in 0.421s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:42 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:43 devstack sudo[115024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b Aug 26 16:30:43 devstack sudo[115024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:43 devstack sudo[115024]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b" returned: 0 in 0.430s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:43 devstack sudo[115030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b Aug 26 16:30:43 devstack sudo[115030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:43 devstack sudo[115030]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:43 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882.470cd0fb-14f5-452c-af45-b69a616be13b" returned: 0 in 0.285s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-470cd0fb-14f5-452c-af45-b69a616be13b" released by "_delete_snapshot" :: held 1.702s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-f79a4d7c-d9c1-4368-baca-66a61cca9882" released by "delete_snapshot" :: held 1.734s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:43 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Created reservations ['7afae43e-3d04-4357-b6bd-80ac90a28977', 'b70012b3-c482-4b2e-8d63-20fbc7a01bfd', '7d94a500-56c6-4a29-a72f-bcb7569ab35e', 'b427750f-1940-4cb0-87a1-a4e5ba1d8e0f'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:43 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Delete snapshot completed successfully. Aug 26 16:30:43 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-07454c48-eae2-46c8-b91a-a9455942261c tempest-ProjectMemberTests-118857739 None] Lock "cinder-470cd0fb-14f5-452c-af45-b69a616be13b-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-f79a4d7c-d9c1-4368-baca-66a61cca9882-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Lock "cinder-f79a4d7c-d9c1-4368-baca-66a61cca9882-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-f79a4d7c-d9c1-4368-baca-66a61cca9882" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:44 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-f79a4d7c-d9c1-4368-baca-66a61cca9882" acquired by "delete_volume" :: waited 0.016s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:44 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1cd817-e757-4d36-b945-63844cb40baa]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:44 devstack sudo[115033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 Aug 26 16:30:44 devstack sudo[115033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:44 devstack sudo[115033]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882" returned: 0 in 0.436s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:44 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:44 devstack sudo[115041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882 Aug 26 16:30:44 devstack sudo[115041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:45 devstack sudo[115041]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f79a4d7c-d9c1-4368-baca-66a61cca9882" returned: 0 in 0.266s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-f79a4d7c-d9c1-4368-baca-66a61cca9882" released by "delete_volume" :: held 0.796s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:45 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Created reservations ['815f05b7-eed2-47d1-a27c-3937670c1160', '78ecb697-95c7-4d80-9113-60fe7a413353', '96650d76-cac5-48a0-b8cb-867c02bba21c', 'b8531a94-2cbc-4341-b112-779de29d9373'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:45 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:45 devstack sudo[115044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:45 devstack sudo[115044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:45 devstack sudo[115044]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:45 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.291s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:45 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:45 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Deleted volume successfully. Aug 26 16:30:45 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-14ca0500-86e8-459b-aa9c-c4bf3414e612 tempest-ProjectMemberTests-118857739 None] Lock "cinder-f79a4d7c-d9c1-4368-baca-66a61cca9882-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:45 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (87869b70-8594-40a8-ac67-801d8921bdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c9488c-8784-456c-a140-30f688844475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c9488c-8784-456c-a140-30f688844475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-972911761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd27437-d377-43a3-8b36-d3444c71992c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:46Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561ab57d-b3d1-42d1-83f6-061da67396c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561ab57d-b3d1-42d1-83f6-061da67396c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41840df-3537-4e58-9115-c953fd8b3b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41840df-3537-4e58-9115-c953fd8b3b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd27437-d377-43a3-8b36-d3444c71992c', 'volume_name': 'volume-0cd27437-d377-43a3-8b36-d3444c71992c', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c5f158-a2ae-42e7-a873-3a17e99deba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c5f158-a2ae-42e7-a873-3a17e99deba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4984e8-8e6c-45d3-8789-e15c18e73e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:46 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Volume 0cd27437-d377-43a3-8b36-d3444c71992c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd27437-d377-43a3-8b36-d3444c71992c', 'volume_size': 1} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-972911761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd27437-d377-43a3-8b36-d3444c71992c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:46Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Creating volume 0cd27437-d377-43a3-8b36-d3444c71992c {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:30:46 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:46 devstack sudo[115048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c 1073741824 Aug 26 16:30:46 devstack sudo[115048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:46 devstack sudo[115048]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c 1073741824" returned: 0 in 0.548s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:46 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:46 devstack sudo[115054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c Aug 26 16:30:46 devstack sudo[115054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:47 devstack sudo[115054]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c" returned: 0 in 0.301s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:47 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:30:47 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4984e8-8e6c-45d3-8789-e15c18e73e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd27437-d377-43a3-8b36-d3444c71992c', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833c3fc6-5a63-4186-bae3-3ccb0a4ac2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:47 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Volume volume-0cd27437-d377-43a3-8b36-d3444c71992c (0cd27437-d377-43a3-8b36-d3444c71992c): created successfully Aug 26 16:30:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833c3fc6-5a63-4186-bae3-3ccb0a4ac2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:47 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (87869b70-8594-40a8-ac67-801d8921bdc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:47 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-4919edd0-f090-4bdc-a43f-773c5a8426a2 tempest-ProjectMemberTests-118857739 None] Created volume successfully. Aug 26 16:30:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:48 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] Creating offline snapshot 80404d04-8ef7-46db-ba1f-a81d8e0e7c06 of volume 0cd27437-d377-43a3-8b36-d3444c71992c {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:30:48 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f6bc17-b671-4ef7-9516-b8743be2c852]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:48 devstack sudo[115057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c Aug 26 16:30:48 devstack sudo[115057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:48 devstack sudo[115057]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c" returned: 0 in 0.374s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:48 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:48 devstack sudo[115062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 1G Aug 26 16:30:48 devstack sudo[115062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:49 devstack sudo[115062]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 1G" returned: 0 in 0.438s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd27437-d377-43a3-8b36-d3444c71992c -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:49 devstack sudo[115068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd27437-d377-43a3-8b36-d3444c71992c -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 Aug 26 16:30:49 devstack sudo[115068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:49 devstack sudo[115068]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd27437-d377-43a3-8b36-d3444c71992c -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06" returned: 0 in 0.290s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:49 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 is being set with open permissions: ugo+rw Aug 26 16:30:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:49 devstack sudo[115073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 Aug 26 16:30:49 devstack sudo[115073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:49 devstack sudo[115073]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06" returned: 0 in 0.247s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:49 devstack sudo[115076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.info Aug 26 16:30:49 devstack sudo[115076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:49 devstack sudo[115076]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.info" returned: 0 in 0.245s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:49 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.info is being set with open permissions: ugo+rw Aug 26 16:30:49 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:50 devstack sudo[115079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.info Aug 26 16:30:50 devstack sudo[115079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:50 devstack sudo[115079]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.info" returned: 0 in 0.240s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.927s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:50 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-3456a50d-9104-475b-bd68-cee308275d0c tempest-ProjectMemberTests-118857739 None] Create snapshot completed successfully Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-80404d04-8ef7-46db-ba1f-a81d8e0e7c06-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Lock "cinder-80404d04-8ef7-46db-ba1f-a81d8e0e7c06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-0cd27437-d377-43a3-8b36-d3444c71992c" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-0cd27437-d377-43a3-8b36-d3444c71992c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-80404d04-8ef7-46db-ba1f-a81d8e0e7c06" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-80404d04-8ef7-46db-ba1f-a81d8e0e7c06" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Deleting offline snapshot 80404d04-8ef7-46db-ba1f-a81d8e0e7c06 of volume 0cd27437-d377-43a3-8b36-d3444c71992c {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] snapshot_file for this snap is: volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2873cac2-d2c9-4bac-93f5-61eb00b6d43f]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:50 devstack sudo[115082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 Aug 26 16:30:50 devstack sudo[115082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:50 devstack sudo[115082]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06" returned: 0 in 0.370s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cd27437-d377-43a3-8b36-d3444c71992c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af92e64-f8bf-4d21-8e3c-8df01a8594f2]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:50 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:51 devstack sudo[115088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c Aug 26 16:30:51 devstack sudo[115088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Flow 'volume_create_manager' (ce62393c-4f98-402b-bf8c-42876cabf39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b7c439e-88b3-49de-b64a-cacccac00fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b7c439e-88b3-49de-b64a-cacccac00fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-922634921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09af2422-46e8-4001-89bb-cf31b172e970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5bb41b1fab44848619bad83bc383f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:51Z,use_quota=True,user_id='85ebd8be90f14d9fb29d57c683dc22ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079a0757-b853-4b7f-989e-944b4e4a1be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079a0757-b853-4b7f-989e-944b4e4a1be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffba0bd-474f-4abc-9f99-ed9755ac08d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffba0bd-474f-4abc-9f99-ed9755ac08d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09af2422-46e8-4001-89bb-cf31b172e970', 'volume_name': 'volume-09af2422-46e8-4001-89bb-cf31b172e970', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97ddf7e-eab6-412b-90f8-cb0cac9e781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97ddf7e-eab6-412b-90f8-cb0cac9e781e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ce2831-4e4a-400f-8d30-006cdd66566e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:51 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Volume 09af2422-46e8-4001-89bb-cf31b172e970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09af2422-46e8-4001-89bb-cf31b172e970', 'volume_size': 1} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-922634921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09af2422-46e8-4001-89bb-cf31b172e970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5bb41b1fab44848619bad83bc383f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:51Z,use_quota=True,user_id='85ebd8be90f14d9fb29d57c683dc22ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Creating volume 09af2422-46e8-4001-89bb-cf31b172e970 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:30:51 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-09af2422-46e8-4001-89bb-cf31b172e970 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:51 devstack sudo[115090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-09af2422-46e8-4001-89bb-cf31b172e970 1073741824 Aug 26 16:30:51 devstack sudo[115090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:51 devstack sudo[115088]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c" returned: 0 in 0.368s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:51 devstack sudo[115095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 Aug 26 16:30:51 devstack sudo[115095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:51 devstack sudo[115090]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-09af2422-46e8-4001-89bb-cf31b172e970 1073741824" returned: 0 in 0.435s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:51 devstack sudo[115095]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06" returned: 0 in 0.372s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-09af2422-46e8-4001-89bb-cf31b172e970 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:51 devstack sudo[115104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06 Aug 26 16:30:51 devstack sudo[115104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:51 devstack sudo[115105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-09af2422-46e8-4001-89bb-cf31b172e970 Aug 26 16:30:51 devstack sudo[115105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:51 devstack sudo[115104]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c.80404d04-8ef7-46db-ba1f-a81d8e0e7c06" returned: 0 in 0.256s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:51 devstack sudo[115105]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-09af2422-46e8-4001-89bb-cf31b172e970" returned: 0 in 0.263s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:51 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-80404d04-8ef7-46db-ba1f-a81d8e0e7c06" released by "_delete_snapshot" :: held 1.468s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ce2831-4e4a-400f-8d30-006cdd66566e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09af2422-46e8-4001-89bb-cf31b172e970', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157344ba-6cf4-47bc-a4d5-270290d29f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:52 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-0cd27437-d377-43a3-8b36-d3444c71992c" released by "delete_snapshot" :: held 1.507s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:52 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Volume volume-09af2422-46e8-4001-89bb-cf31b172e970 (09af2422-46e8-4001-89bb-cf31b172e970): created successfully Aug 26 16:30:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157344ba-6cf4-47bc-a4d5-270290d29f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:52 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Flow 'volume_create_manager' (ce62393c-4f98-402b-bf8c-42876cabf39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:52 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e8b63aac-9ab3-4643-a6bb-d22ba72426a9 tempest-ProjectReaderTests-1982673544 None] Created volume successfully. Aug 26 16:30:52 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Created reservations ['3331b2a6-e8b5-4b76-9656-ba5d0bc7339e', '6701a55b-253d-436f-b519-b216782b163c', 'f79486f1-8ac7-4b65-8007-186597ba78dc', '6ab89edd-f340-4fea-a4eb-35e3654b0eeb'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:52 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Delete snapshot completed successfully. Aug 26 16:30:52 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-3ae653b0-2e69-44db-996e-24e5828818fb tempest-ProjectMemberTests-118857739 None] Lock "cinder-80404d04-8ef7-46db-ba1f-a81d8e0e7c06-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:52 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-0cd27437-d377-43a3-8b36-d3444c71992c-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:52 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Lock "cinder-0cd27437-d377-43a3-8b36-d3444c71992c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:52 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-0cd27437-d377-43a3-8b36-d3444c71992c" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:52 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-0cd27437-d377-43a3-8b36-d3444c71992c" acquired by "delete_volume" :: waited 0.016s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:52 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a00c2f-f645-48f7-aea1-7f527717ab6c]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:52 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:52 devstack sudo[115110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c Aug 26 16:30:52 devstack sudo[115110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:53 devstack sudo[115110]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c" returned: 0 in 0.341s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:53 devstack sudo[115115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c Aug 26 16:30:53 devstack sudo[115115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:53 devstack sudo[115115]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-0cd27437-d377-43a3-8b36-d3444c71992c" returned: 0 in 0.248s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Acquiring lock "cinder-09af2422-46e8-4001-89bb-cf31b172e970-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-0cd27437-d377-43a3-8b36-d3444c71992c" released by "delete_volume" :: held 0.651s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Lock "cinder-09af2422-46e8-4001-89bb-cf31b172e970-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Acquiring lock "cinder-quobyte-09af2422-46e8-4001-89bb-cf31b172e970" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Created reservations ['1845dd42-652d-4477-bfdc-389252f021d4', 'ddfb3c24-2faa-4f02-8648-5e1e915f3e5e', 'b52a356b-7fb8-43d3-9dc8-ca20c8dc45e7', 'b86b4490-1317-4bb7-aa67-00e3e34ebd04'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Lock "cinder-quobyte-09af2422-46e8-4001-89bb-cf31b172e970" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[5645b054-1ade-4b42-ae1d-f90585208ebe]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-09af2422-46e8-4001-89bb-cf31b172e970 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:53 devstack sudo[115119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:53 devstack sudo[115119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:53 devstack sudo[115118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-09af2422-46e8-4001-89bb-cf31b172e970 Aug 26 16:30:53 devstack sudo[115118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:53 devstack sudo[115119]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.260s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:53 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Deleted volume successfully. Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-cba7ee4f-bede-40f0-bb24-a22ceb3d83ba tempest-ProjectMemberTests-118857739 None] Lock "cinder-0cd27437-d377-43a3-8b36-d3444c71992c-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:53 devstack sudo[115118]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-09af2422-46e8-4001-89bb-cf31b172e970" returned: 0 in 0.388s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:53 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-09af2422-46e8-4001-89bb-cf31b172e970 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:53 devstack sudo[115127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-09af2422-46e8-4001-89bb-cf31b172e970 Aug 26 16:30:53 devstack sudo[115127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:54 devstack sudo[115127]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-09af2422-46e8-4001-89bb-cf31b172e970" returned: 0 in 0.291s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Lock "cinder-quobyte-09af2422-46e8-4001-89bb-cf31b172e970" released by "delete_volume" :: held 0.730s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Created reservations ['c37517a9-1f25-44db-a2dd-e7f254379ae3', '3009dbd8-7e40-475b-914c-a2d06b7ce936', 'f9c0e540-8ffe-4911-baac-ee0dca3489a7', '75640092-fc30-4839-9a8a-7de9a4696e16'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:54 devstack sudo[115130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:54 devstack sudo[115130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (6804d8b1-968c-47bf-b741-47d1e6435327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b159bb0-a952-4f92-a629-7b8e78c11138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b159bb0-a952-4f92-a629-7b8e78c11138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014895108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2411dcd5-6291-4ac1-a30a-fac455d9aff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:54Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d138d2-af1f-42a0-9086-bf7355abf66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d138d2-af1f-42a0-9086-bf7355abf66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44b11ca-10d1-4713-8816-7a68e75c77f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44b11ca-10d1-4713-8816-7a68e75c77f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2411dcd5-6291-4ac1-a30a-fac455d9aff8', 'volume_name': 'volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab85c34-3772-4e0c-8b80-bea487fd775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab85c34-3772-4e0c-8b80-bea487fd775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c994e638-8862-44cb-a1fd-9464217e1d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:54 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Volume 2411dcd5-6291-4ac1-a30a-fac455d9aff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8', 'volume_size': 1} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014895108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2411dcd5-6291-4ac1-a30a-fac455d9aff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:54Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Creating volume 2411dcd5-6291-4ac1-a30a-fac455d9aff8 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:30:54 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:54 devstack sudo[115132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 1073741824 Aug 26 16:30:54 devstack sudo[115132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:54 devstack sudo[115130]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.260s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:54 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Deleted volume successfully. Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-7a13df5a-6bc7-4b52-9a12-8fbd7c640e41 tempest-ProjectReaderTests-1982673544 None] Lock "cinder-09af2422-46e8-4001-89bb-cf31b172e970-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:54 devstack sudo[115132]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 1073741824" returned: 0 in 0.471s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:54 devstack sudo[115140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 Aug 26 16:30:54 devstack sudo[115140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:54 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Flow 'volume_create_manager' (4e684318-7d3e-45da-861e-eb8cbb5c240d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3448d8-c674-4792-ba1a-9889c5896e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3448d8-c674-4792-ba1a-9889c5896e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493488291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32511f8-f0a5-4358-8143-bae1d1cbe15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5bb41b1fab44848619bad83bc383f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:55Z,use_quota=True,user_id='85ebd8be90f14d9fb29d57c683dc22ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a9609a-7236-46b2-b9fb-5f257854df54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a9609a-7236-46b2-b9fb-5f257854df54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d558b0e-2558-4246-9d27-ec31f3662cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d558b0e-2558-4246-9d27-ec31f3662cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32511f8-f0a5-4358-8143-bae1d1cbe15f', 'volume_name': 'volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4addee-afc3-44c0-865e-e583c7e12eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4addee-afc3-44c0-865e-e583c7e12eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57746db-3ff0-4882-83a4-acdc1caa0a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:55 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Volume f32511f8-f0a5-4358-8143-bae1d1cbe15f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f', 'volume_size': 1} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:55 devstack sudo[115140]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8" returned: 0 in 0.249s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.116s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493488291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32511f8-f0a5-4358-8143-bae1d1cbe15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5bb41b1fab44848619bad83bc383f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:55Z,use_quota=True,user_id='85ebd8be90f14d9fb29d57c683dc22ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Creating volume f32511f8-f0a5-4358-8143-bae1d1cbe15f {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:30:55 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c994e638-8862-44cb-a1fd-9464217e1d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2866ef-6edb-46e7-9058-e58e4b537138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:55 devstack sudo[115143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f 1073741824 Aug 26 16:30:55 devstack sudo[115143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:55 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Volume volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 (2411dcd5-6291-4ac1-a30a-fac455d9aff8): created successfully Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2866ef-6edb-46e7-9058-e58e4b537138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (6804d8b1-968c-47bf-b741-47d1e6435327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e574f430-0e30-460f-925c-887602962884 tempest-ProjectMemberTests-118857739 None] Created volume successfully. Aug 26 16:30:55 devstack sudo[115143]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f 1073741824" returned: 0 in 0.399s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:55 devstack sudo[115148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f Aug 26 16:30:55 devstack sudo[115148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:55 devstack sudo[115148]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f" returned: 0 in 0.240s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57746db-3ff0-4882-83a4-acdc1caa0a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bfa229-489f-4b67-8f15-c1e44cae1457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:55 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Volume volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f (f32511f8-f0a5-4358-8143-bae1d1cbe15f): created successfully Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bfa229-489f-4b67-8f15-c1e44cae1457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:55 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Flow 'volume_create_manager' (4e684318-7d3e-45da-861e-eb8cbb5c240d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:55 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ada90e8c-7628-4758-8875-8b23d560c8ff tempest-ProjectReaderTests-1982673544 None] Created volume successfully. Aug 26 16:30:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:56 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] Creating offline snapshot d083d7d0-fb93-40fc-a7ed-c045e1fdd216 of volume 2411dcd5-6291-4ac1-a30a-fac455d9aff8 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:30:56 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[75010922-f68b-4d91-b417-3367f153f9fd]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:56 devstack sudo[115151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 Aug 26 16:30:56 devstack sudo[115151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:56 devstack sudo[115151]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8" returned: 0 in 0.349s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:56 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:56 devstack sudo[115156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 1G Aug 26 16:30:56 devstack sudo[115156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Acquiring lock "cinder-f32511f8-f0a5-4358-8143-bae1d1cbe15f-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Lock "cinder-f32511f8-f0a5-4358-8143-bae1d1cbe15f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Acquiring lock "cinder-quobyte-f32511f8-f0a5-4358-8143-bae1d1cbe15f" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Lock "cinder-quobyte-f32511f8-f0a5-4358-8143-bae1d1cbe15f" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b7d927-d413-435b-8e1d-a6e963691743]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:57 devstack sudo[115161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f Aug 26 16:30:57 devstack sudo[115161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:57 devstack sudo[115156]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 1G" returned: 0 in 0.471s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:57 devstack sudo[115163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 Aug 26 16:30:57 devstack sudo[115163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:57 devstack sudo[115161]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f" returned: 0 in 0.394s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:57 devstack sudo[115171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f Aug 26 16:30:57 devstack sudo[115171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:57 devstack sudo[115163]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216" returned: 0 in 0.309s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:57 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 is being set with open permissions: ugo+rw Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:57 devstack sudo[115173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 Aug 26 16:30:57 devstack sudo[115173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:57 devstack sudo[115171]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-f32511f8-f0a5-4358-8143-bae1d1cbe15f" returned: 0 in 0.248s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Lock "cinder-quobyte-f32511f8-f0a5-4358-8143-bae1d1cbe15f" released by "delete_volume" :: held 0.688s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:57 devstack sudo[115173]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216" returned: 0 in 0.250s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Created reservations ['975e2256-4146-415d-af9c-45f52098f09d', '2a9cdc97-bdb8-4a7b-b596-007037a6a09d', '5e93a1cd-04dc-4669-b8a2-1bd7e6e018db', 'dadfcad5-1d1c-48eb-adb3-4d8e10f83ae4'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:30:57 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:57 devstack sudo[115177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.info Aug 26 16:30:57 devstack sudo[115177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:58 devstack sudo[115179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:30:58 devstack sudo[115179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:58 devstack sudo[115177]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.info" returned: 0 in 0.263s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:58 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.info is being set with open permissions: ugo+rw Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:58 devstack sudo[115183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.info Aug 26 16:30:58 devstack sudo[115183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:58 devstack sudo[115179]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.264s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:30:58 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Deleted volume successfully. Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-0e82df26-9faa-481f-ab39-720fde3cdf44 tempest-ProjectReaderTests-1982673544 None] Lock "cinder-f32511f8-f0a5-4358-8143-bae1d1cbe15f-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:30:58 devstack sudo[115183]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.info" returned: 0 in 0.274s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:58 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-31fb552b-3f38-42ac-a880-51e9684f972c tempest-ProjectMemberTests-118857739 None] Create snapshot completed successfully Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Flow 'volume_create_manager' (525b0b99-6d4b-4540-8ad9-20a4a2b9a5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144727dd-5cb9-4735-8d15-fa38e11cb08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144727dd-5cb9-4735-8d15-fa38e11cb08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1779301663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfe27ca-55b3-45a3-b118-a7e630df06be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5bb41b1fab44848619bad83bc383f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:59Z,use_quota=True,user_id='85ebd8be90f14d9fb29d57c683dc22ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ac1f63-fd77-4341-b221-5cfd1e300f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ac1f63-fd77-4341-b221-5cfd1e300f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2784a7ac-1be6-4036-abad-198c42e3c530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2784a7ac-1be6-4036-abad-198c42e3c530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbfe27ca-55b3-45a3-b118-a7e630df06be', 'volume_name': 'volume-bbfe27ca-55b3-45a3-b118-a7e630df06be', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642a80ba-7530-487c-87d8-f3e4d9dc2e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642a80ba-7530-487c-87d8-f3e4d9dc2e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63169b26-518f-4ff2-b5ad-17f913deff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:58 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Volume bbfe27ca-55b3-45a3-b118-a7e630df06be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbfe27ca-55b3-45a3-b118-a7e630df06be', 'volume_size': 1} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1779301663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfe27ca-55b3-45a3-b118-a7e630df06be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5bb41b1fab44848619bad83bc383f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:30:59Z,use_quota=True,user_id='85ebd8be90f14d9fb29d57c683dc22ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Creating volume bbfe27ca-55b3-45a3-b118-a7e630df06be {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:30:58 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:30:58 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbfe27ca-55b3-45a3-b118-a7e630df06be 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:58 devstack sudo[115186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbfe27ca-55b3-45a3-b118-a7e630df06be 1073741824 Aug 26 16:30:58 devstack sudo[115186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:59 devstack sudo[115186]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbfe27ca-55b3-45a3-b118-a7e630df06be 1073741824" returned: 0 in 0.399s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbfe27ca-55b3-45a3-b118-a7e630df06be {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:59 devstack sudo[115192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbfe27ca-55b3-45a3-b118-a7e630df06be Aug 26 16:30:59 devstack sudo[115192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:59 devstack sudo[115192]: pam_unix(sudo:session): session closed for user root Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbfe27ca-55b3-45a3-b118-a7e630df06be" returned: 0 in 0.240s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=223,cinder:SELECT=164,cinder:INSERT=56,cinder:DELETE=17 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63169b26-518f-4ff2-b5ad-17f913deff7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbfe27ca-55b3-45a3-b118-a7e630df06be', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a384ec6-89d2-4be8-a16c-46c1c2acaf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:SELECT=172,cinder:INSERT=59,cinder:UPDATE=207,cinder:DELETE=19 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:30:59 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Volume volume-bbfe27ca-55b3-45a3-b118-a7e630df06be (bbfe27ca-55b3-45a3-b118-a7e630df06be): created successfully Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a384ec6-89d2-4be8-a16c-46c1c2acaf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Flow 'volume_create_manager' (525b0b99-6d4b-4540-8ad9-20a4a2b9a5a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:30:59 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-66242b2e-c794-41a8-9c38-f99dcba3a22c tempest-ProjectReaderTests-1982673544 None] Created volume successfully. Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-d083d7d0-fb93-40fc-a7ed-c045e1fdd216-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Lock "cinder-d083d7d0-fb93-40fc-a7ed-c045e1fdd216-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-2411dcd5-6291-4ac1-a30a-fac455d9aff8" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-2411dcd5-6291-4ac1-a30a-fac455d9aff8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-d083d7d0-fb93-40fc-a7ed-c045e1fdd216" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-d083d7d0-fb93-40fc-a7ed-c045e1fdd216" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Deleting offline snapshot d083d7d0-fb93-40fc-a7ed-c045e1fdd216 of volume 2411dcd5-6291-4ac1-a30a-fac455d9aff8 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] snapshot_file for this snap is: volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cedb46d-7f9b-4ed8-b19d-56b18b93b82a]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Acquiring lock "cinder-bbfe27ca-55b3-45a3-b118-a7e630df06be-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Lock "cinder-bbfe27ca-55b3-45a3-b118-a7e630df06be-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:59 devstack sudo[115195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 Aug 26 16:30:59 devstack sudo[115195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Acquiring lock "cinder-quobyte-bbfe27ca-55b3-45a3-b118-a7e630df06be" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Lock "cinder-quobyte-bbfe27ca-55b3-45a3-b118-a7e630df06be" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[383b6a62-c1c7-4df3-be94-5ce722afa1e2]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:30:59 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbfe27ca-55b3-45a3-b118-a7e630df06be {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:00 devstack sudo[115197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbfe27ca-55b3-45a3-b118-a7e630df06be Aug 26 16:31:00 devstack sudo[115197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:00 devstack sudo[115195]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216" returned: 0 in 0.376s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[600ada95-7b87-4914-9ee1-d818b7d2c657]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:00 devstack sudo[115202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 Aug 26 16:31:00 devstack sudo[115202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:00 devstack sudo[115197]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbfe27ca-55b3-45a3-b118-a7e630df06be" returned: 0 in 0.358s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbfe27ca-55b3-45a3-b118-a7e630df06be {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:00 devstack sudo[115207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbfe27ca-55b3-45a3-b118-a7e630df06be Aug 26 16:31:00 devstack sudo[115207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:00 devstack sudo[115202]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8" returned: 0 in 0.368s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:00 devstack sudo[115207]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-bbfe27ca-55b3-45a3-b118-a7e630df06be" returned: 0 in 0.252s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:00 devstack sudo[115213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 Aug 26 16:31:00 devstack sudo[115213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Lock "cinder-quobyte-bbfe27ca-55b3-45a3-b118-a7e630df06be" released by "delete_volume" :: held 0.654s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Created reservations ['d17b4f78-f470-4dc9-8e78-3d78fa359189', '8c0e23a7-7f79-4319-87ab-91436db95a33', '75e48c45-7a48-4668-a280-fd88a98a1228', '039c2316-4631-4407-94ff-8f9117c39679'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:00 devstack sudo[115215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:31:00 devstack sudo[115215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:00 devstack sudo[115213]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216" returned: 0 in 0.337s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:00 devstack sudo[115220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216 Aug 26 16:31:00 devstack sudo[115220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:00 devstack sudo[115215]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.269s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:00 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:31:00 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Deleted volume successfully. Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-9e14258b-3200-427c-94b1-db182b63cdbd tempest-ProjectReaderTests-1982673544 None] Lock "cinder-bbfe27ca-55b3-45a3-b118-a7e630df06be-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:01 devstack sudo[115220]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8.d083d7d0-fb93-40fc-a7ed-c045e1fdd216" returned: 0 in 0.273s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-d083d7d0-fb93-40fc-a7ed-c045e1fdd216" released by "_delete_snapshot" :: held 1.450s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-2411dcd5-6291-4ac1-a30a-fac455d9aff8" released by "delete_snapshot" :: held 1.479s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Created reservations ['2b6d53c1-e64d-47ab-9420-f5ffb76b8456', '12f09bb4-ce7c-4ea3-94ae-b4d0b5fbd274', 'b850137d-99c5-404f-bbcb-b999c714e57c', '507ef7ed-e831-4399-9fed-566d4f847352'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:31:01 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Delete snapshot completed successfully. Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bef70f98-dbe7-4941-af43-87cac7c577d8 tempest-ProjectMemberTests-118857739 None] Lock "cinder-d083d7d0-fb93-40fc-a7ed-c045e1fdd216-delete_snapshot" released by "delete_snapshot" :: held 1.630s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Flow 'volume_create_manager' (1dcb9fec-5915-47c9-ab90-786b7e2595a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63f6073-4572-44a2-a7ac-9ccb338425bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63f6073-4572-44a2-a7ac-9ccb338425bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-255619880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d75e12d-0434-46fd-83a2-77b3b4278948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5bb41b1fab44848619bad83bc383f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:31:01Z,use_quota=True,user_id='85ebd8be90f14d9fb29d57c683dc22ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc8653c-ae0f-41bd-8fb7-a99e9b5117cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc8653c-ae0f-41bd-8fb7-a99e9b5117cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719ff3f8-ea53-4301-9348-f12bf35a2898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719ff3f8-ea53-4301-9348-f12bf35a2898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d75e12d-0434-46fd-83a2-77b3b4278948', 'volume_name': 'volume-9d75e12d-0434-46fd-83a2-77b3b4278948', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf1ddae-e7b3-43e9-81fa-4541a8a26007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf1ddae-e7b3-43e9-81fa-4541a8a26007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6b6eff-c190-4ca5-91df-d0dc7d4bbf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:01 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Volume 9d75e12d-0434-46fd-83a2-77b3b4278948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d75e12d-0434-46fd-83a2-77b3b4278948', 'volume_size': 1} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-255619880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d75e12d-0434-46fd-83a2-77b3b4278948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5bb41b1fab44848619bad83bc383f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:31:01Z,use_quota=True,user_id='85ebd8be90f14d9fb29d57c683dc22ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Creating volume 9d75e12d-0434-46fd-83a2-77b3b4278948 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:31:01 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9d75e12d-0434-46fd-83a2-77b3b4278948 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:01 devstack sudo[115224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9d75e12d-0434-46fd-83a2-77b3b4278948 1073741824 Aug 26 16:31:01 devstack sudo[115224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-2411dcd5-6291-4ac1-a30a-fac455d9aff8-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Lock "cinder-2411dcd5-6291-4ac1-a30a-fac455d9aff8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-2411dcd5-6291-4ac1-a30a-fac455d9aff8" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-2411dcd5-6291-4ac1-a30a-fac455d9aff8" acquired by "delete_volume" :: waited 0.016s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c8ad4e-d12d-4add-8f68-24d34a198602]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:01 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:02 devstack sudo[115224]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9d75e12d-0434-46fd-83a2-77b3b4278948 1073741824" returned: 0 in 0.484s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9d75e12d-0434-46fd-83a2-77b3b4278948 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:02 devstack sudo[115231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9d75e12d-0434-46fd-83a2-77b3b4278948 Aug 26 16:31:02 devstack sudo[115231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:02 devstack sudo[115230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 Aug 26 16:31:02 devstack sudo[115230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:02 devstack sudo[115231]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9d75e12d-0434-46fd-83a2-77b3b4278948" returned: 0 in 0.260s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6b6eff-c190-4ca5-91df-d0dc7d4bbf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d75e12d-0434-46fd-83a2-77b3b4278948', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d1975c-6ffe-401c-b661-e84968ea2dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:02 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Volume volume-9d75e12d-0434-46fd-83a2-77b3b4278948 (9d75e12d-0434-46fd-83a2-77b3b4278948): created successfully Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d1975c-6ffe-401c-b661-e84968ea2dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Flow 'volume_create_manager' (1dcb9fec-5915-47c9-ab90-786b7e2595a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:31:02 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e14b5638-ee95-4852-9c67-967baca7679e tempest-ProjectReaderTests-1982673544 None] Created volume successfully. Aug 26 16:31:02 devstack sudo[115230]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8" returned: 0 in 0.403s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:02 devstack sudo[115239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8 Aug 26 16:31:02 devstack sudo[115239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:02 devstack sudo[115239]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-2411dcd5-6291-4ac1-a30a-fac455d9aff8" returned: 0 in 0.234s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-2411dcd5-6291-4ac1-a30a-fac455d9aff8" released by "delete_volume" :: held 0.694s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Created reservations ['e0209b18-632e-41e7-9d3a-cefefd9d153c', '5cf91e18-a019-49ce-8dc2-3079092cf7ea', 'bbc0c429-4c8a-4ebd-8d4d-30df7b2e6fa5', '815880b9-c499-4eb4-95b7-17f354418ca7'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:02 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:02 devstack sudo[115242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:31:02 devstack sudo[115242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:03 devstack sudo[115242]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.247s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:31:03 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Deleted volume successfully. Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-79bdcaa1-c55d-4f99-8947-0d3c4ff9c532 tempest-ProjectMemberTests-118857739 None] Lock "cinder-2411dcd5-6291-4ac1-a30a-fac455d9aff8-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (ce695157-5170-4640-b6cf-2747d0d83914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f095759-94a2-4254-aa89-5c49324728a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f095759-94a2-4254-aa89-5c49324728a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-6765498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b490524f-73dd-43b5-a633-bcc5de6bc353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:31:03Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae105ac5-878d-47f0-9283-7d67964d4031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae105ac5-878d-47f0-9283-7d67964d4031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb33e841-e2bc-4ea1-9a1e-3a14484d7dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb33e841-e2bc-4ea1-9a1e-3a14484d7dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b490524f-73dd-43b5-a633-bcc5de6bc353', 'volume_name': 'volume-b490524f-73dd-43b5-a633-bcc5de6bc353', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97552ab3-a541-4bcd-9342-1785f4311baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97552ab3-a541-4bcd-9342-1785f4311baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5db86d-1f84-486e-9d84-c4f6907f10c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:03 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Volume b490524f-73dd-43b5-a633-bcc5de6bc353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b490524f-73dd-43b5-a633-bcc5de6bc353', 'volume_size': 1} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-6765498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b490524f-73dd-43b5-a633-bcc5de6bc353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:31:03Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Creating volume b490524f-73dd-43b5-a633-bcc5de6bc353 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:31:03 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Acquiring lock "cinder-9d75e12d-0434-46fd-83a2-77b3b4278948-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:03 devstack sudo[115245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353 1073741824 Aug 26 16:31:03 devstack sudo[115245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Lock "cinder-9d75e12d-0434-46fd-83a2-77b3b4278948-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Acquiring lock "cinder-quobyte-9d75e12d-0434-46fd-83a2-77b3b4278948" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Lock "cinder-quobyte-9d75e12d-0434-46fd-83a2-77b3b4278948" acquired by "delete_volume" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b34b88c-8cb5-451c-8018-bec5c7bcad50]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:03 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9d75e12d-0434-46fd-83a2-77b3b4278948 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:03 devstack sudo[115247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9d75e12d-0434-46fd-83a2-77b3b4278948 Aug 26 16:31:03 devstack sudo[115247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:04 devstack sudo[115245]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353 1073741824" returned: 0 in 0.457s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:04 devstack sudo[115247]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9d75e12d-0434-46fd-83a2-77b3b4278948" returned: 0 in 0.387s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9d75e12d-0434-46fd-83a2-77b3b4278948 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:04 devstack sudo[115255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353 Aug 26 16:31:04 devstack sudo[115255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:04 devstack sudo[115256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9d75e12d-0434-46fd-83a2-77b3b4278948 Aug 26 16:31:04 devstack sudo[115256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:04 devstack sudo[115255]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353" returned: 0 in 0.248s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:04 devstack sudo[115256]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-9d75e12d-0434-46fd-83a2-77b3b4278948" returned: 0 in 0.240s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5db86d-1f84-486e-9d84-c4f6907f10c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b490524f-73dd-43b5-a633-bcc5de6bc353', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b91e2a-dbc7-409f-a4f4-5b6de65d0cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Lock "cinder-quobyte-9d75e12d-0434-46fd-83a2-77b3b4278948" released by "delete_volume" :: held 0.680s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:04 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Volume volume-b490524f-73dd-43b5-a633-bcc5de6bc353 (b490524f-73dd-43b5-a633-bcc5de6bc353): created successfully Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b91e2a-dbc7-409f-a4f4-5b6de65d0cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (ce695157-5170-4640-b6cf-2747d0d83914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:31:04 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-7fcbae42-7ef3-45ae-9f1d-9a6fb7385e7b tempest-ProjectMemberTests-118857739 None] Created volume successfully. Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Created reservations ['15f558d8-ed9b-4efc-a1d0-a5c02931003b', '9085b39c-8368-4105-8135-78c0eb44aedc', '3610da24-b9e0-42d4-a36a-e95273cfb68a', 'd5122772-0a4f-4f4a-8239-729508c15284'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:04 devstack sudo[115261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:31:04 devstack sudo[115261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] Creating offline snapshot a7a55971-83fa-4a4c-8429-ef589b52511f of volume b490524f-73dd-43b5-a633-bcc5de6bc353 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[be294757-a330-415c-86ff-73f59a6a2978]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:04 devstack sudo[115261]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.278s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:31:04 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Deleted volume successfully. Aug 26 16:31:04 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-c6b5da3a-7b31-4d93-86e3-673ec5e0074d tempest-ProjectReaderTests-1982673544 None] Lock "cinder-9d75e12d-0434-46fd-83a2-77b3b4278948-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:04 devstack sudo[115264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353 Aug 26 16:31:04 devstack sudo[115264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:05 devstack sudo[115264]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353" returned: 0 in 0.393s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:05 devstack sudo[115270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f 1G Aug 26 16:31:05 devstack sudo[115270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:05 devstack sudo[115270]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f 1G" returned: 0 in 0.395s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b490524f-73dd-43b5-a633-bcc5de6bc353 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:05 devstack sudo[115275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b490524f-73dd-43b5-a633-bcc5de6bc353 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f Aug 26 16:31:05 devstack sudo[115275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:05 devstack sudo[115275]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b490524f-73dd-43b5-a633-bcc5de6bc353 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f" returned: 0 in 0.307s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:05 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f is being set with open permissions: ugo+rw Aug 26 16:31:05 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:05 devstack sudo[115280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f Aug 26 16:31:05 devstack sudo[115280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:06 devstack sudo[115280]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f" returned: 0 in 0.253s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:06 devstack sudo[115283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.info Aug 26 16:31:06 devstack sudo[115283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:06 devstack sudo[115283]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.info" returned: 0 in 0.252s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:06 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.info is being set with open permissions: ugo+rw Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:06 devstack sudo[115286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.info Aug 26 16:31:06 devstack sudo[115286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:06 devstack sudo[115286]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.info" returned: 0 in 0.245s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:06 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-e32f8b2e-078b-4503-9882-fb32c5dc8fb4 tempest-ProjectMemberTests-118857739 None] Create snapshot completed successfully Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-a7a55971-83fa-4a4c-8429-ef589b52511f-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Lock "cinder-a7a55971-83fa-4a4c-8429-ef589b52511f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-b490524f-73dd-43b5-a633-bcc5de6bc353" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-b490524f-73dd-43b5-a633-bcc5de6bc353" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-a7a55971-83fa-4a4c-8429-ef589b52511f" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-a7a55971-83fa-4a4c-8429-ef589b52511f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Deleting offline snapshot a7a55971-83fa-4a4c-8429-ef589b52511f of volume b490524f-73dd-43b5-a633-bcc5de6bc353 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] snapshot_file for this snap is: volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0f52a3-4b74-4420-ba2f-4e2c063c2271]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:06 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:07 devstack sudo[115289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f Aug 26 16:31:07 devstack sudo[115289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:07 devstack sudo[115289]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f" returned: 0 in 0.352s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:07 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b490524f-73dd-43b5-a633-bcc5de6bc353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:31:07 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f54bdc-e93f-44ca-afad-9b984294f9ff]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:07 devstack sudo[115294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353 Aug 26 16:31:07 devstack sudo[115294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:07 devstack sudo[115294]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353" returned: 0 in 0.335s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:07 devstack sudo[115299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f Aug 26 16:31:07 devstack sudo[115299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:07 devstack sudo[115299]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f" returned: 0 in 0.321s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:07 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:07 devstack sudo[115304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f Aug 26 16:31:07 devstack sudo[115304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:08 devstack sudo[115304]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:08 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353.a7a55971-83fa-4a4c-8429-ef589b52511f" returned: 0 in 0.242s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-a7a55971-83fa-4a4c-8429-ef589b52511f" released by "_delete_snapshot" :: held 1.343s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-b490524f-73dd-43b5-a633-bcc5de6bc353" released by "delete_snapshot" :: held 1.367s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:08 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Created reservations ['42b937c5-c8d5-4a0a-b88a-fedd03298666', '530c322c-76ba-4047-bdfc-fe1dce47fe7a', '61cbf478-c892-4687-974a-14af9bc0fae6', 'bb689b00-85b6-4997-a4df-27867fefba3a'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:31:08 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Delete snapshot completed successfully. Aug 26 16:31:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-bdc3fb37-fed9-4a43-a054-0d3fc9b67b07 tempest-ProjectMemberTests-118857739 None] Lock "cinder-a7a55971-83fa-4a4c-8429-ef589b52511f-delete_snapshot" released by "delete_snapshot" :: held 1.520s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-b490524f-73dd-43b5-a633-bcc5de6bc353-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:08 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Lock "cinder-b490524f-73dd-43b5-a633-bcc5de6bc353-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-b490524f-73dd-43b5-a633-bcc5de6bc353" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-b490524f-73dd-43b5-a633-bcc5de6bc353" acquired by "delete_volume" :: waited 0.014s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f89430-407c-458e-b3a9-911a334121f9]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:09 devstack sudo[115308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353 Aug 26 16:31:09 devstack sudo[115308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:09 devstack sudo[115308]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353" returned: 0 in 0.334s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:09 devstack sudo[115313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353 Aug 26 16:31:09 devstack sudo[115313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:09 devstack sudo[115313]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-b490524f-73dd-43b5-a633-bcc5de6bc353" returned: 0 in 0.238s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-b490524f-73dd-43b5-a633-bcc5de6bc353" released by "delete_volume" :: held 0.635s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Created reservations ['eac418dc-6f48-45c2-89fd-c38d4fd52d85', '36a0bbb2-a0ce-479a-955e-fd0015d9a216', '76b447ad-a690-4bff-860e-ad606001f287', '48a969db-eb43-4930-a254-4d369707b81a'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:09 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:09 devstack sudo[115316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:31:09 devstack sudo[115316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:10 devstack sudo[115316]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.236s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:31:10 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Deleted volume successfully. Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-514eca78-d950-435c-a55e-bcb69ae73e04 tempest-ProjectMemberTests-118857739 None] Lock "cinder-b490524f-73dd-43b5-a633-bcc5de6bc353-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (0b87ec30-c3d6-479f-88dc-63c39377ee1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9083faec-5f27-4050-84a6-1b08b0b77813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9083faec-5f27-4050-84a6-1b08b0b77813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1332434915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fb4a6a-d948-48e5-b485-16fc218e8209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:31:11Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26def818-11c1-4a2c-8b2c-4446375ae9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26def818-11c1-4a2c-8b2c-4446375ae9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e11640d-b86f-4891-a824-b9fe1fef23c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e11640d-b86f-4891-a824-b9fe1fef23c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43fb4a6a-d948-48e5-b485-16fc218e8209', 'volume_name': 'volume-43fb4a6a-d948-48e5-b485-16fc218e8209', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d266a6c8-3204-47e9-9819-4aed20af9fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d266a6c8-3204-47e9-9819-4aed20af9fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9951636-0632-4e79-9cf2-5a02fe5730dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:10 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Volume 43fb4a6a-d948-48e5-b485-16fc218e8209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43fb4a6a-d948-48e5-b485-16fc218e8209', 'volume_size': 1} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1332434915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fb4a6a-d948-48e5-b485-16fc218e8209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:31:11Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Creating volume 43fb4a6a-d948-48e5-b485-16fc218e8209 {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:31:10 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:31:10 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:10 devstack sudo[115319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209 1073741824 Aug 26 16:31:10 devstack sudo[115319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:11 devstack sudo[115319]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209 1073741824" returned: 0 in 0.409s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:11 devstack sudo[115324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209 Aug 26 16:31:11 devstack sudo[115324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:11 devstack sudo[115324]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209" returned: 0 in 0.239s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9951636-0632-4e79-9cf2-5a02fe5730dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43fb4a6a-d948-48e5-b485-16fc218e8209', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f7f788-c8dd-40f6-ab86-1bf70053c689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:11 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Volume volume-43fb4a6a-d948-48e5-b485-16fc218e8209 (43fb4a6a-d948-48e5-b485-16fc218e8209): created successfully Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f7f788-c8dd-40f6-ab86-1bf70053c689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (0b87ec30-c3d6-479f-88dc-63c39377ee1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:31:11 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-cfa33f68-0031-49d7-822b-c84bc088eef7 tempest-ProjectMemberTests-118857739 None] Created volume successfully. Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] Creating offline snapshot b135ea81-5f68-4272-90ed-79a37332d767 of volume 43fb4a6a-d948-48e5-b485-16fc218e8209 {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2a53e8-6646-498d-b9af-d55717aaf2df]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:11 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:11 devstack sudo[115328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209 Aug 26 16:31:11 devstack sudo[115328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:12 devstack sudo[115328]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209" returned: 0 in 0.361s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:12 devstack sudo[115333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 1G Aug 26 16:31:12 devstack sudo[115333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:12 devstack sudo[115333]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 1G" returned: 0 in 0.387s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fb4a6a-d948-48e5-b485-16fc218e8209 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:12 devstack sudo[115338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fb4a6a-d948-48e5-b485-16fc218e8209 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 Aug 26 16:31:12 devstack sudo[115338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:12 devstack sudo[115338]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43fb4a6a-d948-48e5-b485-16fc218e8209 -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767" returned: 0 in 0.294s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:12 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 is being set with open permissions: ugo+rw Aug 26 16:31:12 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:12 devstack sudo[115343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 Aug 26 16:31:12 devstack sudo[115343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:13 devstack sudo[115343]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767" returned: 0 in 0.247s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:13 devstack sudo[115346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.info Aug 26 16:31:13 devstack sudo[115346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:13 devstack sudo[115346]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.info" returned: 0 in 0.279s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:13 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.info is being set with open permissions: ugo+rw Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:13 devstack sudo[115349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.info Aug 26 16:31:13 devstack sudo[115349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:13 devstack sudo[115349]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.info" returned: 0 in 0.240s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:13 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b658c035-ebae-4379-8caf-a253ba3b23b8 tempest-ProjectMemberTests-118857739 None] Create snapshot completed successfully Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-b135ea81-5f68-4272-90ed-79a37332d767-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Lock "cinder-b135ea81-5f68-4272-90ed-79a37332d767-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-43fb4a6a-d948-48e5-b485-16fc218e8209" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-43fb4a6a-d948-48e5-b485-16fc218e8209" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-b135ea81-5f68-4272-90ed-79a37332d767" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-b135ea81-5f68-4272-90ed-79a37332d767" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Deleting offline snapshot b135ea81-5f68-4272-90ed-79a37332d767 of volume 43fb4a6a-d948-48e5-b485-16fc218e8209 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] snapshot_file for this snap is: volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc6d1ad-353d-410d-8687-96871b53d029]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:13 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:14 devstack sudo[115352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 Aug 26 16:31:14 devstack sudo[115352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:14 devstack sudo[115352]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767" returned: 0 in 0.356s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:14 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43fb4a6a-d948-48e5-b485-16fc218e8209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:31:14 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[911c59e4-be62-4f52-921f-aee8beee5738]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:14 devstack sudo[115359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209 Aug 26 16:31:14 devstack sudo[115359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:14 devstack sudo[115359]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209" returned: 0 in 0.353s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:14 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:14 devstack sudo[115364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 Aug 26 16:31:14 devstack sudo[115364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:15 devstack sudo[115364]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767" returned: 0 in 0.342s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:15 devstack sudo[115370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767 Aug 26 16:31:15 devstack sudo[115370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:15 devstack sudo[115370]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:15 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209.b135ea81-5f68-4272-90ed-79a37332d767" returned: 0 in 0.254s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-b135ea81-5f68-4272-90ed-79a37332d767" released by "_delete_snapshot" :: held 1.395s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-43fb4a6a-d948-48e5-b485-16fc218e8209" released by "delete_snapshot" :: held 1.419s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:15 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Created reservations ['83b9815d-5a1f-40bc-b431-3581182c1d55', '08252c8e-a200-48f8-91a8-cfc6a6e7e92f', '7d3dcf25-f538-4850-905a-865983375819', '1cd953e2-7c40-4244-ba45-7088f34b893e'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:31:15 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Delete snapshot completed successfully. Aug 26 16:31:15 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ab3e7ac1-da68-4b9b-8356-200e7983f898 tempest-ProjectMemberTests-118857739 None] Lock "cinder-b135ea81-5f68-4272-90ed-79a37332d767-delete_snapshot" released by "delete_snapshot" :: held 1.554s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-43fb4a6a-d948-48e5-b485-16fc218e8209-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Lock "cinder-43fb4a6a-d948-48e5-b485-16fc218e8209-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-43fb4a6a-d948-48e5-b485-16fc218e8209" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-43fb4a6a-d948-48e5-b485-16fc218e8209" acquired by "delete_volume" :: waited 0.019s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9ba1d3-7c0d-41c3-aa91-3f1ee4a36600]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:16 devstack sudo[115373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209 Aug 26 16:31:16 devstack sudo[115373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:16 devstack sudo[115373]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209" returned: 0 in 0.344s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:16 devstack sudo[115378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209 Aug 26 16:31:16 devstack sudo[115378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:16 devstack sudo[115378]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-43fb4a6a-d948-48e5-b485-16fc218e8209" returned: 0 in 0.243s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-43fb4a6a-d948-48e5-b485-16fc218e8209" released by "delete_volume" :: held 0.644s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Created reservations ['bd287bd4-4131-4e6c-b1b5-197dfc8c80dc', '945e234c-3ef8-4349-9c6d-afa55bfe6e04', '618c5acb-dce3-4ca2-96ab-8d6dcf2cfe52', '69631a55-a4a4-40a4-8d6f-7dfeedcc9b24'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:16 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:16 devstack sudo[115381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:31:16 devstack sudo[115381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:17 devstack sudo[115381]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.258s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:31:17 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Deleted volume successfully. Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-b12b16f9-32bf-4066-9a0f-9ab491ded2b9 tempest-ProjectMemberTests-118857739 None] Lock "cinder-43fb4a6a-d948-48e5-b485-16fc218e8209-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (832ae55e-2482-4e35-8de9-0e9ec7cfafef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6178626e-4774-4468-a8e1-ff2eb96fd13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6178626e-4774-4468-a8e1-ff2eb96fd13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1938720951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e80195-491a-4565-9a1b-250effbc174b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:31:18Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526f394c-4a85-418b-b622-688ec8999fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526f394c-4a85-418b-b622-688ec8999fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a431fb9-b089-4d69-850d-37734f839fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a431fb9-b089-4d69-850d-37734f839fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85e80195-491a-4565-9a1b-250effbc174b', 'volume_name': 'volume-85e80195-491a-4565-9a1b-250effbc174b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0b2082-b64b-4e4d-9dd6-bfa82d01abf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0b2082-b64b-4e4d-9dd6-bfa82d01abf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87625df5-8c41-4040-a78c-e4d3d4fd13a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:17 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Volume 85e80195-491a-4565-9a1b-250effbc174b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85e80195-491a-4565-9a1b-250effbc174b', 'volume_size': 1} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T14:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1938720951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e80195-491a-4565-9a1b-250effbc174b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9afc4551b92848de86c98b96ef84630b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T14:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T14:31:18Z,use_quota=True,user_id='c27d860e8e654803b166b8aa74d98ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad4c990e-21b3-4209-9235-c3890e3ff230),volume_type_id=ad4c990e-21b3-4209-9235-c3890e3ff230)}" {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Creating volume 85e80195-491a-4565-9a1b-250effbc174b {{(pid=94407) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Selected osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 as target Quobyte volume. {{(pid=94407) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 16:31:17 devstack cinder-volume[94407]: INFO cinder.volume.drivers.remotefs [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] casted to osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5 Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b 1073741824 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:17 devstack sudo[115384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b 1073741824 Aug 26 16:31:17 devstack sudo[115384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:17 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:18 devstack sudo[115389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:31:18 devstack sudo[115389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:18 devstack sudo[115384]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b 1073741824" returned: 0 in 0.420s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:18 devstack sudo[115393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b Aug 26 16:31:18 devstack sudo[115393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:18 devstack sudo[115389]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.257s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG oslo_service.periodic_task [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] Running periodic task VolumeManager._thread_info {{(pid=94407) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread count: 29 {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-71563847-5079-4d51-8346-fbf77bce2295 None None] thread info: [<_MainThread(MainThread, started 125978376843392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94407) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 16:31:18 devstack sudo[115393]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b" returned: 0 in 0.252s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'} {{(pid=94407) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87625df5-8c41-4040-a78c-e4d3d4fd13a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e80195-491a-4565-9a1b-250effbc174b', 'volume_size': 1}' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7bc189-e40c-4369-aaa7-5ec1d26b3528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 16:31:18 devstack cinder-volume[94407]: INFO cinder.volume.flows.manager.create_volume [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Volume volume-85e80195-491a-4565-9a1b-250effbc174b (85e80195-491a-4565-9a1b-250effbc174b): created successfully Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7bc189-e40c-4369-aaa7-5ec1d26b3528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94407) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Flow 'volume_create_manager' (832ae55e-2482-4e35-8de9-0e9ec7cfafef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94407) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 16:31:18 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-aaf96952-9cac-4803-af3c-d91ae4bfb9d1 tempest-ProjectMemberTests-118857739 None] Created volume successfully. Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] Creating offline snapshot 136ddbbf-9c94-4167-b7b3-8faca4314ffe of volume 85e80195-491a-4565-9a1b-250effbc174b {{(pid=94407) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72d6722-f316-4439-9438-b01316f9a73b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:18 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:18 devstack sudo[115396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b Aug 26 16:31:18 devstack sudo[115396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:19 devstack sudo[115396]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b" returned: 0 in 0.366s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe 1G {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:19 devstack sudo[115401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe 1G Aug 26 16:31:19 devstack sudo[115401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:19 devstack sudo[115401]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe 1G" returned: 0 in 0.390s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e80195-491a-4565-9a1b-250effbc174b -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:19 devstack sudo[115406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e80195-491a-4565-9a1b-250effbc174b -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe Aug 26 16:31:19 devstack sudo[115406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:19 devstack sudo[115406]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e80195-491a-4565-9a1b-250effbc174b -F qcow2 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe" returned: 0 in 0.296s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:19 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe is being set with open permissions: ugo+rw Aug 26 16:31:19 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:19 devstack sudo[115411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe Aug 26 16:31:19 devstack sudo[115411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:20 devstack sudo[115411]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe" returned: 0 in 0.246s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:20 devstack sudo[115414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.info Aug 26 16:31:20 devstack sudo[115414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:20 devstack sudo[115414]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.info" returned: 0 in 0.268s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:20 devstack cinder-volume[94407]: WARNING cinder.volume.drivers.remotefs [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.info is being set with open permissions: ugo+rw Aug 26 16:31:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.info {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:20 devstack sudo[115417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.info Aug 26 16:31:20 devstack sudo[115417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:20 devstack sudo[115417]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.info" returned: 0 in 0.253s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:20 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:20 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-8ca638f1-3025-4e22-b07f-10dd207ac656 tempest-ProjectMemberTests-118857739 None] Create snapshot completed successfully Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-136ddbbf-9c94-4167-b7b3-8faca4314ffe-delete_snapshot" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Lock "cinder-136ddbbf-9c94-4167-b7b3-8faca4314ffe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-85e80195-491a-4565-9a1b-250effbc174b" by "delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-85e80195-491a-4565-9a1b-250effbc174b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-136ddbbf-9c94-4167-b7b3-8faca4314ffe" by "_delete_snapshot" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-136ddbbf-9c94-4167-b7b3-8faca4314ffe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Deleting offline snapshot 136ddbbf-9c94-4167-b7b3-8faca4314ffe of volume 85e80195-491a-4565-9a1b-250effbc174b {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] snapshot_file for this snap is: volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe {{(pid=94407) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dd681a-f7a5-4d3a-a0e6-2161beeddd3b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:21 devstack sudo[115420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe Aug 26 16:31:21 devstack sudo[115420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:21 devstack sudo[115420]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe" returned: 0 in 0.383s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.remotefs [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85e80195-491a-4565-9a1b-250effbc174b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94407) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19e5a9d-d0bb-4fb3-8b6c-511f054c713b]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:21 devstack sudo[115425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b Aug 26 16:31:21 devstack sudo[115425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:21 devstack sudo[115425]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b" returned: 0 in 0.383s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:21 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:21 devstack sudo[115430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe Aug 26 16:31:21 devstack sudo[115430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:22 devstack sudo[115430]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe" returned: 0 in 0.359s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:22 devstack sudo[115435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe Aug 26 16:31:22 devstack sudo[115435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:22 devstack sudo[115435]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:22 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b.136ddbbf-9c94-4167-b7b3-8faca4314ffe" returned: 0 in 0.243s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-136ddbbf-9c94-4167-b7b3-8faca4314ffe" released by "_delete_snapshot" :: held 1.470s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-85e80195-491a-4565-9a1b-250effbc174b" released by "delete_snapshot" :: held 1.495s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:22 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Created reservations ['d5a200c7-2eca-420f-9eb7-964ad6e9738d', '26962210-6c3c-4f2f-85ff-b237328fb492', '6e535cb1-61be-42ec-b7f0-f91aa8c26c8a', '68c1b77e-ced0-49b8-8295-2209a0ba1521'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:31:22 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Delete snapshot completed successfully. Aug 26 16:31:22 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-434ed69b-b327-4ab3-a6cf-264cf1699014 tempest-ProjectMemberTests-118857739 None] Lock "cinder-136ddbbf-9c94-4167-b7b3-8faca4314ffe-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-85e80195-491a-4565-9a1b-250effbc174b-delete_volume" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Lock "cinder-85e80195-491a-4565-9a1b-250effbc174b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Acquiring lock "cinder-quobyte-85e80195-491a-4565-9a1b-250effbc174b" by "delete_volume" {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 16:31:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-85e80195-491a-4565-9a1b-250effbc174b" acquired by "delete_volume" :: waited 0.017s {{(pid=94407) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 16:31:23 devstack cinder-volume[94407]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed4782c-23e0-4e9a-bee7-246607953eed]: (4, 'qcow2') {{(pid=95757) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 16:31:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:23 devstack sudo[115438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b Aug 26 16:31:23 devstack sudo[115438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:23 devstack sudo[115438]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b" returned: 0 in 0.359s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:23 devstack sudo[115444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b Aug 26 16:31:23 devstack sudo[115444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:23 devstack sudo[115444]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:23 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193/volume-85e80195-491a-4565-9a1b-250effbc174b" returned: 0 in 0.249s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:23 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Lock "cinder-quobyte-85e80195-491a-4565-9a1b-250effbc174b" released by "delete_volume" :: held 0.665s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:23 devstack cinder-volume[94407]: DEBUG cinder.quota [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Created reservations ['de70b54d-7401-4d92-b34b-6f413f6329c7', '7050bfa5-a4cc-4cd9-9a5d-68cf103f144f', 'c617d935-5a50-4f3a-b0e0-aadd27726549', '268790e6-a503-4fe5-9f9e-082e9faf6521'] {{(pid=94407) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 16:31:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 16:31:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 16:31:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5': None} {{(pid=94407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 16:31:24 devstack cinder-volume[94407]: DEBUG cinder.volume.drivers.quobyte [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f098ce30-67ff-41f0-a643-a44e1c7e72e5'] {{(pid=94407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 16:31:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.lockutils [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94407) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 16:31:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 16:31:24 devstack sudo[115447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193 Aug 26 16:31:24 devstack sudo[115447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 16:31:24 devstack sudo[115447]: pam_unix(sudo:session): session closed for user root Aug 26 16:31:24 devstack cinder-volume[94407]: DEBUG oslo_concurrency.processutils [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/98644c22bc4441bb80edb75504f37193" returned: 0 in 0.259s {{(pid=94407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 16:31:24 devstack cinder-volume[94407]: DEBUG cinder.manager [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Notifying Schedulers of capabilities ... {{(pid=94407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 16:31:24 devstack cinder-volume[94407]: INFO cinder.volume.manager [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Deleted volume successfully. Aug 26 16:31:24 devstack cinder-volume[94407]: DEBUG cinder.coordination [None req-ae0bd4cc-408d-4cdd-b9de-0b770b0d388e tempest-ProjectMemberTests-118857739 None] Lock "cinder-85e80195-491a-4565-9a1b-250effbc174b-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=94407) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 16:31:34 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=92,cinder:SELECT=65,cinder:INSERT=20,cinder:DELETE=8 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 16:31:34 devstack cinder-volume[94407]: DEBUG dbcounter [-] [94407] Writing DB stats cinder:UPDATE=82,cinder:DELETE=6,cinder:SELECT=62,cinder:INSERT=27 {{(pid=94407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}